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Linear Equations 
in Linear Algebra 


1.1 SOLUTIONS 


Notes: The key exercises are 7 (or 11 or 12), 19-22, and 25. For brevity, the symbols Rl, R2,..., stand for 
row 1 ( or equation 1), row 2 (or equation 2), and so on. Additional notes are at the end of the section. 


x, + 5x, = 7 15 7 

1 . 1 

-2x!-7x 2 =-5 |_-2 -7 -5 

Replace R2 by R2 + (2)R1 and obtain: 

Scale R2 by 1/3: 

Replace Rl by Rl + (-5)R2: 

The solution is (jti, x 2 ) = (-8, 3), or simply (-8, 3). 


Xj + 5x 2 = 7 
3x 2 = 9 

Xj + 5 x 2 = 7 
x 2 = 3 

x, = -8 
x 2 = 3 


2xj + 4 x 2 = -4 2 4 -4 

5x, + 7x 2 =11 [5 7 11 

Scale Rl by 1/2 and obtain: 
Replace R2 by R2 + (-5)R1 : 
Scale R2 by -1/3: 

Replace Rl by Rl + (-2)R2: 


x, + 2x 2 = -2 
5xj + 7 x 2 = 11 

Xj + 2 x 2 = -2 
-3x 2 =21 

X| + 2x 2 = -2 
x 2 = -7 

Xj = 12 

x 2 =-7 


The solution is (xi, x 2 ) = (12, -7), or simply (12, -7). 


1 5 7 

0 3 9 

1 5 7' 

0 1 3 

1 0 -8 

0 1 3 


1 2 -2 
5 7 11 

1 2-2 

0 -3 21 

1 2 -2 

0 1 -7_ 

1 0 12 

0 1 -7 


1 



2 CHAPTER 1 • Linear Equations in Linear Algebra 


3 . The point of intersection satisfies the system of two linear equations: 

X[ + 5x 2 = 7 15 7 

x 1 - 2 x 2 =-2 1-2 -2 

Replace R2 by R2 + (-l)Rl and obtain: 

Scale R2 by -1/7: 

Replace R1 by R1 + (-5)R2: 

The point of intersection is (jti, x 2 ) = (4/7, 9/7). 

4 . The point of intersection satisfies the system of two linear equations: 

jcj - 5x 2 =1 1-5 1 

3xj-7x 2 =5 _3 -7 5 

Replace R2 by R2 + (-3)R1 and obtain: 

Scale R2 by 1/8: 

Replace R1 by R1 + (5)R2: 

The point of intersection is ( jci , x 2 ) = (9/4, 1/4). 

5 . The system is already in “triangular” form. The fourth equation is X 4 = -5, and the other equations do not 
contain the variable X4. The next two steps should be to use the variable x 2 , in the third equation to 
eliminate that variable from the first two equations. In matrix notation, that means to replace R2 by its 
sum with 3 times R3, and then replace R1 by its sum with -5 times R3. 


x x - 5x 2 =1 1-5 1 

8 x 2 = 2 |_0 8 2 

\ - 5x 2 =1 1-5 1 

x 2 =l/4 |_0 1 1/4 

= 9/4 n 0 9/4' 

jc 2 =1/4 |_0 1 1/4 


1 + 5x 2 

= 7 

'l 

5 

1 

-lx 2 

= -9 

_0 

-7 

-9 

+ 5x 2 = 

= 7 

"l 

5 

7 " 

x 2 = 

= 9/7 

_0 

1 

9/1 _ 

= 

= 4/7 

"l 

0 

4/7" 

X 2 ~ 

= 9/7 

_0 

1 

9/1 _ 


6 . One more step will put the system in triangular form. Replace R4 by its sum with -3 times R3, which 
"1 -6 4 0 -1] 

0 2 -7 0 4 

produces . After that, the next step is to scale the fourth row by -1/5. 

0 0 12-3 

0 0 0 -5 15 


7. Ordinarily, the next step would be to interchange R3 and R4, to put a 1 in the third row and third column. 
But in this case, the third row of the augmented matrix corresponds to the equation 0 x\ + 0 x 2 + 0 *3 = 1, 
or simply, 0 = 1. A system containing this condition has no solution. Further row operations are 
unnecessary once an equation such as 0 = 1 is evident. 

The solution set is empty. 
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8. The standard row operations are: 


"1 

-4 

9 

0 " 


"1 

-4 

9 

0 " 


"1 

-4 

0 

0 " 


"1 

0 

0 

0 " 

0 

1 

7 

0 

~ 

0 

1 

7 

0 

~ 

0 

1 

0 

0 

~ 

0 

1 

0 

0 

0 

0 

2 

0 


0 

0 

1 

0 


0 

0 

1 

0 


0 

0 

1 

0 


The solution set contains one solution: (0, 0, 0). 

9 . The system has already been reduced to triangular form. Begin by scaling the fourth row by 1/2 and then 
replacing R3 by R3 + (3)R4: 


"1 

-1 

0 

0 

-4' 


“1 

-1 

0 

0 

-4' 


“1 

-1 

0 

0 

-4 

0 

1 

-3 

0 

-7 


0 

1 

-3 

0 

7 


0 

1 

-3 

0 

-1 

0 

0 

1 

-3 

-1 


0 

0 

1 

-3 

-1 


0 

0 

1 

0 

5 

0 

0 

0 

2 

4 


0 

0 

0 

1 

2 


0 

0 

0 

1 

2 


Next, replace R2 by R2 + (3)R3. Finally, replace R1 by R1 + R2: 


"1 

-1 

0 

0 

-4' 


"1 

0 

0 

0 

4' 

0 

1 

0 

0 

8 


0 

1 

0 

0 

8 

0 

0 

1 

0 

5 


0 

0 

1 

0 

5 

0 

0 

0 

1 

2 


0 

0 

0 

1 

2 


The solution set contains one solution: (4, 8, 5, 2). 

10 . The system has already been reduced to triangular form. Use the 1 in the fourth row to change the 
-4 and 3 above it to zeros. That is, replace R2 by R2 + (4)R4 and replace R1 by R1 + (-3)R4. For the 
final step, replace R1 by R1 + (2)R2. 


“1 

-2 

0 

3 

-2“ 


“1 

-2 

0 

0 

7' 


“1 

0 

0 

0 

-3' 

0 

1 

0 

-4 

7 


0 

1 

0 

0 

-5 


0 

1 

0 

0 

-5 

0 

0 

1 

0 

6 


0 

0 

1 

0 

6 


0 

0 

1 

0 

6 

0 

0 

0 

1 

-3 


0 

0 

0 

1 

-3 


0 

0 

0 

1 

-3 


The solution set contains one solution: (-3, -5, 6, -3). 

11 . First, swap R1 and R2. Then replace R3 by R3 + (— 3)R1. Finally, replace R3 by R3 + (2)R2. 


“0 

1 

4 

-5“ 


“1 

3 

5 

-2 


“1 

3 

5 

-2 


“1 

3 

5 

-2 

1 

3 

5 

-2 

~ 

0 

1 

4 

-5 

~ 

0 

1 

4 

-5 

~ 

0 

1 

4 

-5 

3 

7 

7 

6 


3 

7 

7 

6 


0 

-2 

-8 

12 


0 

0 

0 

2 


The system is inconsistent, because the last row would require that 0 = 2 if there were a solution. 
The solution set is empty. 

12 . Replace R2 by R2 + (-3)R1 and replace R3 by R3 + (4)R1. Finally, replace R3 by R3 + (3)R2. 


1 

-3 

4 

-4 


“1 

-3 

4 

- 4 


“1 

-3 

4 

-4' 

3 

-7 

7 

-8 

~ 

0 

2 

-5 

4 

~ 

0 

2 

-5 

4 

-4 

6 

-1 

7_ 


0 

-6 

15 

-9 


0 

0 

0 

3 


The system is inconsistent, because the last row would require that 0 = 3 if there were a solution. 
The solution set is empty. 
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"1 

0 

-3 

8" 


"1 

0 

-3 

8" 


"1 

0 

-3 

8" 


"1 

0 

-3 

8" 

13 . 

2 

2 

9 

7 

~ 

0 

2 

15 

-9 

~ 

0 

1 

5 

-2 

~ 

0 

1 

5 

-2 


0 

1 

5 

-2 


0 

1 

5 

-2 


0 

2 

15 

-9 


0 

0 

5 

-5 


“1 

0 

-3 

_l 

8" 

L. 

“1 

0 

0 

_l 

5“ 

1_ _l 1_ 

0 

1 

5 

-2 

~ 

0 

1 

0 

3 

. The solution is (5, 3, -1). 

0 

0 

1 

-1 


0 

0 

1 

-1 



1 

-3 

0 

5“ 


“1 

-3 

0 

5“ 


“1 

-3 

0 

5“ 


“1 

-3 

0 

5' 

-1 

1 

5 

2 

~ 

0 

-2 

5 

7 

~ 

0 

1 

1 

0 

~ 

0 

1 

1 

0 

0 

1 

1 

0 


0 

1 

1 

0 


0 

-2 

5 

7_ 


0 

0 

7 

7_ 


"1 

-3 

0 

5“ 


"1 

-3 

0 

5“ 


"1 

0 

0 

2" 


0 

1 

1 

0 

~ 

0 

1 

0 

-1 

~ 

0 

1 

0 

-1 

. The solution is (2,-1, 1). 

0 

0 

1 

1 


0 

0 

1 

1 


0 

0 

1 

1 



15 . First, replace R4 by R4 + (-3)R1, then replace R3 by R3 + (2)R2, and finally replace R4 by R4 + (3)R3. 


"1 

0 

3 

0 

2" 


"1 

0 

3 

0 

2" 

0 

1 

0 

-3 

3 


0 

1 

0 

-3 

3 

0 

-2 

3 

2 

1 


0 

-2 

3 

2 

1 

3 

0 

0 

7 

-5_ 


0 

0 

-9 

7 

-11 

J 


“1 

0 

3 

0 


2" 


“1 0 

3 

0 

2“ 



0 

1 

0 

-3 


3 


0 1 

0 

-3 

3 



0 

0 

3 

-4 


7 


0 0 

3 

-4 

7 



0 

0 

-9 

7 

- 

11 


1 

o 

o 

0 

-5 

10 



The resulting triangular system indicates that a solution exists. In fact, using the argument from Example 2, 
one can see that the solution is unique. 

16 . First replace R4 by R4 + (2)R1 and replace R4 by R4 + (-3/2)R2. (One could also scale R2 before 
adding to R4, but the arithmetic is rather easy keeping R2 unchanged.) Finally, replace R4 by R4 + R3. 


1 

0 

0 

-2 

-3' 


“1 

0 

0 

-2 

-3" 

0 

2 

2 

0 

0 


0 

2 

2 

0 

0 

0 

0 

1 

3 

1 


0 

0 

1 

3 

1 

-2 

3 

2 

1 

5_ 


0 

3 

2 

-3 

-1 


“1 

0 

0 

-2 

-3“ 


“1 

0 

0 

-2 

-3' 

0 

2 

2 

0 

0 


0 

2 

2 

0 

0 

0 

0 

1 

3 

1 


0 

0 

1 

3 

1 

0 

0 

-1 

-3 

-1 


0 

0 

0 

0 

0 


The system is now in triangular form and has a solution. The next section discusses how to continue with 
this type of system. 
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17. Row reduce the augmented matrix corresponding to the given system of three equations: 


1 

-4 

f 


"1 

-4 

f 


"1 

-4 

f 

2 

-1 

-3 

~ 

0 

7 

-5 

~ 

0 

7 

-5 

-1 

-3 

4 


0 

-7 

5 


0 

0 

0 


The system is consistent, and using the argument from Example 2, there is only one solution. So the three 
lines have only one point in common. 

18. Row reduce the augmented matrix corresponding to the given system of three equations: 


"1 

2 

1 

4" 


"1 

2 

1 4" 


"1 

2 

1 

4" 

0 

1 

-1 

1 

~ 

0 

1 - 

1 1 

~ 

0 

1 

-1 

1 

1 

3 

0 

0 


0 

1 - 

1 -4 


0 

0 

0 

— 5_ 


The third equation, 0 = -5, shows that the system is inconsistent, so the three planes have no point in 
common. 


19. 


20 . 


21 . 


22 . 


"1 

h 

4" 


"1 

h 

4 ' 

3 

6 

8 


0 

6-3 h 

-4 


Write c for 6 - 3 h. If c = 0, that is, if h = 2, then the system has no 
solution, because 0 cannot equal -4. Otherwise, when h ^ 2, the system has a solution. 


1 

h 

-3' 


"1 h -3" 

-2 

4 

6 


0 4 + 2/; 0 


. Write c for 4 + 2h. Then the second equation cx 2 = 0 has a solution 
for every value of c. So the system is consistent for all h. 


1 

3 

-2 


"1 

3 

-2 

-4 

h 

8 


0 

A + 12 

0 


. Write c for h + 12. Then the second equation cx 2 = 0 has a solution 
for every value of c. So the system is consistent for all h. 

The system is consistent if and only if 5 + 3h = 0, that is, if and only 


" 2 

-3 

h 


"2 

-3 

h 

-6 

9 

5_ 


0 

0 

5 + 3 h_ 


if h = -5/3. 


23. a. True. See the remarks following the box titled Elementary Row Operations. 

b. False. A 5 x 6 matrix has five rows. 

c. False. The description given applied to a single solution. The solution set consists of all possible 
solutions. Only in special cases does the solution set consist of exactly one solution. Mark a statement 
True only if the statement is always true. 

d. True. See the box before Example 2. 

24. a. True. See the box preceding the subsection titled Existence and Uniqueness Questions. 

b. False. The definition of row equivalent requires that there exist a sequence of row operations that 
transforms one matrix into the other. 

c. False. By definition, an inconsistent system has no solution. 

d. True. This definition of equivalent systems is in the second paragraph after equation (2). 
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1 

-4 

7 

g 


"1 

-4 

7 

g 


"1 

-4 

7 

g 

0 

3 

-5 

h 

~ 

0 

3 

-5 

h 

~ 

0 

3 

-5 

h 

-2 

5 

-9 

k 


0 

-3 

5 

k + 2g_ 


0 

0 

0 

k+2g+h 


Let b denote the number k + 2g + h. Then the third equation represented by the augmented matrix above 
is 0 = b. This equation is possible if and only if b is zero. So the original system has a solution if and only 
if k + 2g + h = 0. 


26 . A basic principle of this section is that row operations do not affect the solution set of a linear system. 
Begin with a simple augmented matrix for which the solution is obviously (-2, 1, 0), and then perform 
any elementary row operations to produce other augmented matrices. Here are three examples. The fact 
that they are all row equivalent proves that they all have the solution set (-2, 1, 0). 


"1 

0 

0 

-2" 


"1 

0 

0 

-2 


"1 

0 

0 

-2 

0 

1 

0 

1 

~ 

2 

1 

0 

-3 

~ 

2 

1 

0 

-3 

0 

0 

1 

0 


0 

0 

1 

0 


2 

0 

1 

-4 


27 . Study the augmented matrix for the given system, replacing R2 by R2 + (-c)Rl : 


"1 3 f 


1 

1 

S d g _ 


0 d -3c g~cf J 


This shows that shows d - 3c must be nonzero, since / and g are arbitrary. Otherwise, for some choices 
of / and g the second row would correspond to an equation of the form 0 = b, where b is nonzero. 

Thus d * 3 c. 


28 . Row reduce the augmented matrix for the given system. Scale the first row by 1/a, which is possible 
since a is nonzero. Then replace R2 by R2 + (-c)Rl. 


a b f 


1 bl a f / a 


1 bl a f / a 

_c d g_ 


_ c d g 


0 d-c{b/a) g-c(fla) 


The quantity d - c(b/a) must be nonzero, in order for the system to be consistent when the quantity 
g - c(f la) is nonzero (which can certainly happen). The condition that d - c(b/a) ^ 0 can also be written 
as ad - be ^ 0, or ad =£ be. 

29. Swap R1 and R2; swap R1 and R2. 

30 . Multiply R2 by -1/2; multiply R2 by -2. 

31 . Replace R3 by R3 + (-4)R1; replace R3 by R3 + (4)R1. 

32 . Replace R3 by R3 + (3)R2; replace R3 by R3 + (-3)R2. 

33. The first equation was given. The others are: 

t 2 =(ij +20 + 40 + r 3 )/4, or 47) - 7 ; - 7) = 60 

7) = (7) + 7) + 40 + 30)/ 4, or 47) - 7; - 7) = 70 

r 4 =(io+r 1 + r 3 + 30)/4, or 47’ 4 -r 1 -r 3 =40 
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Rearranging, 

47] - T 2 
-7] + 4T 2 - 
~T 2 + 
~T\ 


- T 4 = 30 

r 3 = 60 

4 r 3 - t 4 = 70 

r 3 + 4r 4 = 40 


34 . Begin by interchanging R1 and R4, then create zeros in the first column: 


' 4 

-1 

0 

-1 

30" 


"-1 

0 

-1 

4 

40' 


"-1 

0 

-1 

4 

40" 

-1 

4 

-1 

0 

60 


-1 

4 

-1 

0 

60 


0 

4 

0 

-4 

20 

0 

-1 

4 

-1 

70 


0 

-1 

4 

-1 

70 


0 

-1 

4 

-1 

70 

-1 

0 

-1 

4 

40 


4 

-1 

0 

-1 

30 


0 

-1 

-4 

15 

190 


Scale R1 by -1 and R2 by 1/4, create zeros in the second column, and replace R4 by R4 + R3: 


"1 

0 

1 

-4 

-40" 


"1 

0 

1 

-4 

-40" 


"1 

0 

1 

-4 

-40" 

0 

1 

0 

-1 

5 


0 

1 

0 

-1 

5 


0 

1 

0 

-1 

5 

0 

-1 

4 

-1 

70 


0 

0 

4 

-2 

75 


0 

0 

4 

-2 

75 

0 

-1 

-4 

15 

190 


0 

0 

-4 

14 

195 


0 

0 

0 

12 

270_ 


Scale R4 by 1/12, use R4 to create zeros in column 4, and then scale R3 by 1/4: 


"1 

0 

1 

-4 

-40" 


"1 

0 

1 

0 

50" 


"1 

0 

1 

0 

50" 

0 

1 

0 

-1 

5 


0 

1 

0 

0 

27.5 


0 

1 

0 

0 

27.5 

0 

0 

4 

-2 

75 


0 

0 

4 

0 

120 


0 

0 

1 

0 

30 

0 

0 

0 

1 

22. 5_ 


0 

0 

0 

1 

22. 5_ 


0 

0 

0 

1 

22. 5_ 


The last step is to replace R1 by R1 + (— 1 )R3 : 


10 0 0 
0 10 0 
0 0 10 
0 0 0 1 


20.0 

27.5 
30.0 

22.5 


The solution is (20, 27.5, 30, 22.5). 


Notes: The Study Guide includes a “Mathematical Note” about statements, “If . . . , then ... .” 

This early in the course, students typically use single row operations to reduce a matrix. As a result, even 
the small grid for Exercise 34 leads to about 25 multiplications or additions (not counting operations with 
zero). This exercise should give students an appreciation for matrix programs such as MATLAB. Exercise 14 
in Section 1.10 returns to this problem and states the solution in case students have not already solved the 
system of equations. Exercise 31 in Section 2.5 uses this same type of problem in connection with an LU 
factorization. 

For instructors who wish to use technology in the course, the Study Guide provides boxed MATLAB 
notes at the ends of many sections. Parallel notes for Maple, Mathematica, and the TI-83+/86/89 and HP-48G 
calculators appear in separate appendices at the end of the Study Guide. The MATLAB box for Section 1 . 1 
describes how to access the data that is available for all numerical exercises in the text. This feature has the 
ability to save students time if they regularly have their matrix program at hand when studying linear algebra. 
The MATLAB box also explains the basic commands replace, swap, and scale. These commands are 
included in the text data sets, available from the text web site, www.laylinalgebra.com . 
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1.2 SOLUTIONS 


Notes: The key exercises are 1-20 and 23-28. (Students should work at least four or five from Exercises 
7-14, in preparation for Section 1.5.) 


1. Reduced echelon form: a and b. Echelon form: d. Not echelon: c. 


2. Reduced echelon form: a. Echelon form: b and d. Not echelon: c. 


“1 

2 

3 

4' 


“1 

2 

3 

4' 


“1 

2 

3 

4' 

4 

5 

6 

7 

~ 

0 

-3 

-6 

-9 

~ 

0 

1 

2 

3 

6 

7 

8 

9 


0 

-5 

-10 

— !5_ 


0 

-5 

-10 

-15 


"1 

2 

3 

4' 


© 

0 

-1 

-2" 


© 

2 

3 

4' 

0 

1 

2 

3 

~ 

0 

© 

2 

3 

. Pivot cols 1 and 2. 

4 

© 

6 

7 

0 

0 

0 

0 


0 

0 

0 

0 


6 

7 

8 

9 



"1 

3 

5 

7' 


"1 

3 

5 

7 " 


"1 

3 

5 

7 " 


"1 

3 

5 

1 

4 . 

3 

5 

7 

9 

~ 

0 

-4 

-8 

-12 

~ 

0 

1 

2 

3 

~ 

0 

1 

2 

3 


5 

7 

9 

1 


0 

-8 

-16 

-34 


0 

-8 

-16 

-34 


0 

0 

0 

-10 


“1 

3 

5 

7' 


“1 

3 

5 

0" 


© 0 

-1 

0" 


© 

3 

5 

7' 

0 

1 

2 

3 

~ 

0 

1 

2 

0 

~ 

0 © 

2 

0 

Pivot cols 
1,2, and 4 

3 

© 

7 

9 

0 

0 

0 

1 


0 

0 

0 

1 


0 0 

0 

© 

5 

7 

9 

© 








'■ 

* 


'■ 

* 


"0 

■“ 


■ 

* 

'■ 

*“ 

“0 

■ 










5 . 






6 . 

0 

■ 


0 

0 


0 

0 


0 

■ ' 

1 ° 

O ' 

’ 0 

0 


















0 

0 


0 

0 


0 

0 


“1 3 4 7' 


“134 7" 


“1 3 4 7" 


©30 -5“ 

3 9 7 6 


0 0 -5 -15 


0 0 ! 3 


_0 0 © 3_ 


Corresponding system of equations: 


+ 3x 1 

' © 


-5 

3 


The basic variables (corresponding to the pivot positions) are X\ and x 3 . The remaining variable x 2 is free. 
Solve for the basic variables in terms of the free variable. The general solution is 

jfj = —5 — 3 x 2 
■ x 2 is free 
x 3 = 3 


Note: Exercise 7 is paired with Exercise 10. 
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8 . 


“1 4 0 7' 


1 

4^ 

O 

1 


“1 4 0 7' 


“® 0 0 -9“ 

2 7 0 10 


1 

O 

O 

1 

4^ 

1 


1 

O 

O 

1 


0®0 4_ 


Corresponding system of equations: 


= -9 
= 4 


The basic variables (corresponding to the pivot positions) are jci and x 2 . The remaining variable x 3 is free. 
Solve for the basic variables in terms of the free variable. In this particular problem, the basic variables 
do not depend on the value of the free variable. 

k =-9 


General solution: 


x 2 =4 
x 3 is free 


Note: A common error in Exercise 8 is to assume that x 3 is zero. To avoid this, identify the basic variables 
first. Any remaining variables are free. (This type of computation will arise in Chapter 5.) 


9. 


“0 1 -6 5“ 


1 

1 

K) 

1 

On 
1 


'© 0 -5 4' 

1 -2 7 -6 


1 

in 

^O 

1 

O 

1 


0©-65 


Corresponding system: 


- 5x 3 = 4 

- 6x, = 5 


Basic variables: x\, x 2 ; free variable: x 3 . General solution: 


Xj =4 + 5x 3 
x 2 = 5 + 6x 3 
x 3 is free 


10 . 


“1 -2 -1 3“ 


“1 -2 -1 3“ 


® -2 0 -4' 

_3 -6 -2 2 


1 

O 

O 

1 

1 


0 0 0 -7_ 


Corresponding system: 


© - 2x, 


= -4 
= -7 


Basic variables: x u x 3 ; free variable: x 2 . General solution: 


Xj = -4 + 2 x 2 
x 2 is free 
x 3 = -7 



3 

-4 

2 

0“ 


“3 

-4 

2 

0“ 


0 -4/3 

2/3 

0“ 

11 . 

-9 

12 

-6 

0 

~ 

0 

0 

0 

0 

~ 

0 0 

0 

0 


-6 

8 

-4 

0 


0 

0 

0 

0 


0 0 

0 

0 


Corresponding system: 


© “ ~ X 2 + ~ X 3 = 0 

= 0 
= 0 


2 

3' 

0 

0 
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Basic variable: x t ; free variables x 2 , x 3 . General solution: 


4 2 

JCi — Xo 

3 3 

- x 2 is free 
x 3 is free 



1 

-7 

0 

6 

5“ 


“1 

-7 

0 

6 5“ 


© 

-7 

0 

6 

5" 

12. 

0 

0 

1 

-2 

-3 

~ 

0 

0 

1 

-2 -3 

~ 

0 

0 

CD 

-2 

-3 


-1 

7 

-4 

2 

7_ 


0 

0 

-4 

8 12 


0 

0 

0 

0 

0 






(5 

) • 

- 

7x 2 

+ 

Q \ 

X 

II 


5 






Corresponding system: (x^ - 2x 4 = -3 


0=0 


Basic variables: xi and x 3 ; free variables: x 2 , x 4 . General solution: 


Xj = 5 + 7 x 2 - 6x 4 
x 2 is free 
x 3 = -3 + 2x 4 
x 4 is free 


13. 


"1 

-3 

0 

-1 

0 

-2 


"1 

-3 

0 

0 

9 

2" 


© 

0 

0 

0 

-3 

0 

1 

0 

0 

-4 

1 


0 

1 

0 

0 

-4 

1 


0 

© 

0 

0 

-4 

0 

0 

0 

1 

9 

4 


0 

0 

0 

1 

9 

4 


0 

0 

0 

© 

9 

0 

0 

0 

0 

0 

0_ 


0 

0 

0 

0 

0 

0 


0 

0 

0 

0 

0 


Corresponding system: 


- 3x 5 = 

- 4x, = 


rx 4 ) + 9x s 


0 = 


Basic variables: Xi, x 2 , x 4 ; free variables: x 3 , x 5 . General solution: 


Xj = 5 + 3 x 5 
x 2 = 1 + 4x 5 
■ x 3 is free 
x 4 = 4 - 9x 5 
x 5 is free 


Note: The Study Guide discusses the common mistake x 3 = 0. 


“1 

2 

-5 

-6 

0 

-5' 


© 

0 

7 

0 

0 

-9 

0 

1 

-6 

-3 

0 

2 


0 

© 

-6 

-3 

0 

2 

0 

0 

0 

0 

1 

0 


0 

0 

0 

0 

© 

0 

0 

0 

0 

0 

0 

0 


0 

0 

0 

0 

0 

0 


14 . 



1.2 • 


Solutions 


11 



+ 


Corresponding system: 



7x 3 

6x 3 


3x 4 



-9 

2 

0 

0 


Basic variables: x h x 2 , x 5 ; free variables: x 3 , x 4 . General solution: 


Xj = -9-7 x 3 
x 2 = 2 + 6x 3 + 3x 4 
■ x 3 is free 
x 4 is free 
x 5 = 0 


15. a. The system is consistent, with a unique solution. 

b. The system is inconsistent. (The rightmost column of the augmented matrix is a pivot column). 

16. a. The system is consistent, with a unique solution. 

b. The system is consistent. There are many solutions because x 2 is a free variable. 


17. 


2 3 h 

4 6 7 


3) 3 h 
0 0 7-2/t 


The system has a solution only if 7 - 2h = 0, that is, if h = 7/2. 


18. 


1 -3 -2 

5 /; -7 


© -3 - 2 ' 

0/7 + 15 3 


If h +15 is zero, that is, if h = -15, then the system has no solution, 


because 0 cannot equal 3. Otherwise, when /; ^ -15, the system has a solution. 


19. 


1 

4 


/; 2 
8 k 


© h 2 
0 8-4/; k- 8 


a. When h = 2 and k + 8, the augmented column is a pivot column, and the system is inconsistent. 

b. When /; + 2, the system is consistent and has a unique solution. There are no free variables. 

c. When h = 2 and k= 8, the system is consistent and has many solutions. 


20 . 


"1 

3 

2" 

r 

3 

/; 

k 



3 

h-9 


2 

k - 6 


a. When h = 9 and k + 6, the system is inconsistent, because the augmented column is a pivot column. 

b. When h + 9, the system is consistent and has a unique solution. There are no free variables. 

c. When h = 9 and k = 6, the system is consistent and has many solutions. 


21. a. False. See Theorem 1. 

b. False. See the second paragraph of the section. 

c. True. Basic variables are defined after equation (4). 

d. True. This statement is at the beginning of Parametric Descriptions of Solution Sets. 

e. False. The row shown corresponds to the equation 5xq = 0, which does not by itself lead to a 
contradiction. So the system might be consistent or it might be inconsistent. 
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22. a. False. See the statement preceding Theorem 1. Only the reduced echelon form is unique. 

b. False. See the beginning of the subsection Pivot Positions. The pivot positions in a matrix are 
determined completely by the positions of the leading entries in the nonzero rows of any echelon 
form obtained from the matrix. 

c. True. See the paragraph after Example 3. 

d. False. The existence of at least one solution is not related to the presence or absence of free variables. 
If the system is inconsistent, the solution set is empty. See the solution of Practice Problem 2. 

e. True. See the paragraph just before Example 4. 

23. Yes. The system is consistent because with three pivots, there must be a pivot in the third (bottom) row 
of the coefficient matrix. The reduced echelon form cannot contain a row of the form 

[0 0 0 0 0 1 ]. 

24. The system is inconsistent because the pivot in column 5 means that there is a row of the form 

[0 0 0 0 1]. Since the matrix is the augmented matrix for a system, Theorem 2 shows that the system 
has no solution. 

25. If the coefficient matrix has a pivot position in every row, then there is a pivot position in the bottom 
row, and there is no room for a pivot in the augmented column. So, the system is consistent, by 
Theorem 2. 


26. Since there are three pivots (one in each row), the augmented matrix must reduce to the form 


'©00a 
0 © 0 b 
0 0©c 


and so 





a 

b 

c 


No matter what the values of a, b, and c, the solution exists and is unique. 


27. “If a linear system is consistent, then the solution is unique if and only if every column in the coefficient 
matrix is a pivot column; otherwise there are infinitely many solutions. 

This statement is true because the free variables correspond to nonpivot columns of the coefficient 
matrix. The columns are all pivot columns if and only if there are no free variables. And there are no free 
variables if and only if the solution is unique, by Theorem 2. 


28. Every column in the augmented matrix except the rightmost column is a pivot column, and the rightmost 
column is not a pivot column. 

29. An underdetermined system always has more variables than equations. There cannot be more basic 
variables than there are equations, so there must be at least one free variable. Such a variable may be 
assigned infinitely many different values. If the system is consistent, each different value of a free 
variable will produce a different solution. 


30. Example: 

2jtj 


+ x 2 + x 3 
+ 2x 2 + 2x 3 


4 

5 


31. Yes, a system of linear equations with more equations than u nk nowns can be consistent. 

X\ + x 2 = 2 

Example (in which xi =X 2 = 1): jq - x 2 = 0 

3xj + 2 x 2 = 5 



1.2 


Solutions 


13 


32. According to the numerical note in Section 1.2, when n = 30 the reduction to echelon form takes about 
2(30) 3 /3 = 18,000 flops, while further reduction to reduced echelon form needs at most (30) 2 = 900 flops. 
Of the total flops, the “backward phase” is about 900/18900 = .048 or about 5%. 

When n = 300, the estimates are 2(300) 3 /3 = 18,000,000 phase for the reduction to echelon form and 
(300) 2 = 90,000 flops for the backward phase. The fraction associated with the backward phase is about 
(9xl0 4 ) /( 1 8 x 1 0 6 ) = .005, or about .5%. 

33. For a quadratic polynomial p(t ) = a 0 + a\t + a 2 t 2 to exactly fit the data (1, 12), (2, 15), and (3, 16), the 
coefficients ao, a\, a 2 must satisfy the systems of equations given in the text. Row reduce the augmented 
matrix: 

"i i i i 2 i ri i i 12 ] r i i i 12 ] r i i i i 2 " 

124 15 -0 13 3-0 13 3-0 13 3 

1 3 9 16] |_0 2 8 4J |_0 0 2 -2] [o 0 1-1 

"1 1 0 13] r® 0 0 7" 

-0 10 6 — 0 (T) 0 6 

oo i -ij L° o CD -i 

The polynomial is p(t ) = 7 + 6t - t 2 . 

34. [M] The system of equations to be solved is: 


a 0 

+ 

a x ■ 0 

+ 

a 2 -0 2 

+ 

a 3 ■ 0 3 

+ 

r\ 4 

a 4 • 0 

+ 

a 5 ■ ° 5 

= 0 

a 0 

+ 

a, -2 

+ 

a 2 ' 2 2 

+ 

a 3 • 2 3 

+ 

a 4 -2 4 

+ 

a s ' 2 5 

= 2.90 

a 0 

+ 

a x -4 

+ 

a 2 
a 2 ' 4 

+ 

a 3 • 4 3 

+ 

a 4 -4 4 

+ 

a 5 ' 4 5 

= 14.8 

a 0 

+ 

a { ■ 6 

+ 

a 2 ■ 6 

+ 

a 3 ■ 6 3 

+ 

a 4 ■ 6 4 

+ 

a 5 ■ 6 5 

= 39.6 

a 0 

+ 

a x ■ 8 

+ 

a 2 ■ 8 2 

+ 

a 3 ■ 8 3 

+ 

a 4 ■ 8 4 

+ 

a 5 ■ 8 

= 74.3 

a 0 

+ 

a x ■ 10 

+ 

a 2 • 10 2 

+ 

a 3 ■ 1 0 3 

+ 

a 4 • 10 4 

+ 

a 5 ■ 10 5 

= 119 


The unknowns are a 0 , a u a 5 . Use technology to compute the reduced echelon of the augmented 
matrix: 

"iooo o o o] n o o o o o o" 

1 2 4 8 16 32 2.9 0 2 4 8 16 32 2.9 

1 4 16 64 256 1024 14.8 0 0 8 48 224 960 9 

1 6 36 216 1296 7776 39.6 0 0 24 192 1248 7680 30.9 

1 8 64 512 4096 32768 74.3 0 0 48 480 4032 32640 62.7 

1 10 10 2 10 3 10 4 10 5 119 0 0 80 960 9920 99840 104.5 

"100 0 0 0 0] T 1 0 0 0 0 0 0" 

0 2 4 8 16 32 2.9 0 2 4 8 16 32 2.9 

0 0 8 48 224 960 9 0 0 8 48 224 960 9 

0 0 0 48 576 4800 3.9 ~ 0 0 0 48 576 4800 3.9 

0 0 0 192 2688 26880 8.7 0 0 0 0 384 7680 -6.9 

0 0 0 480 7680 90240 14.5 0 0 0 0 1920 42240 -24.5 
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1 

0 

0 

0 

0 


0 0 " 


"1 

0 

0 

0 


0 

0 

0 " 

0 

2 

4 

8 

16 


32 2.9 


0 

2 

4 

8 


16 

32 

2.9 

0 

0 

8 

48 

224 

960 9 


0 

0 

8 

48 

224 

960 

9 

0 

0 

0 

48 

576 

4800 3.9 


0 

0 

0 

48 

576 

4800 

3.9 

0 

0 

0 

0 

384 

7680 -6.9 


0 

0 

0 

0 

384 

7680 

-6.9 

0 

0 

0 

0 

0 

3840 10 


0 

0 

0 

0 


0 

1 

.0026 

1 

0 

0 

0 

0 

0 

O' 


"1 

0 

0 

0 

0 

0 

0 " 

0 

2 

4 

8 

16 

0 

2.8167 


0 

1 

0 

0 

0 

0 

1.7125 

0 

0 

8 

48 

224 

0 

6.5000 


0 

0 

1 

0 

0 

0 - 

-1.1948 

0 

0 

0 

48 

576 

0 

-8.6000 



0 

0 

0 

1 

0 

0 

.6615 

0 

0 

0 

0 

384 

0 

-26.900 


0 

0 

0 

0 

1 

0 

-.0701 

0 

0 

0 

0 

0 

1 

.002604 


0 

0 

0 

0 

0 

1 

.0026 


Thus p(t) = 1.7125?- 1.1 948r + .66 15? 3 - .070 1? 4 + .0026? 5 , and p( 7.5) = 64.6 hundred lb. 

Notes: In Exercise 34, if the coefficients are retained to higher accuracy than shown here, then p( 7.5) = 64.8. 
If a polynomial of lower degree is used, the resulting system of equations is overdetermined. The augmented 
matrix for such a system is the same as the one used to find p, except that at least column 6 is missing. When 
the augmented matrix is row reduced, the sixth row of the augmented matrix will be entirely zero except for a 
nonzero entry in the augmented column, indicating that no solution exists. 

Exercise 34 requires 25 row operations. It should give students an appreciation for higher-level 
commands such as gauss and bgauss, discussed in Section 1.4 of the Study Guide. The command ref 
(reduced echelon form) is available, but 1 recommend postponing that command until Chapter 2. 

The Study Guide includes a “Mathematical Note” about the phrase, “If and only if,” used in Theorem 2. 


1.3 SOLUTIONS 


Notes: The key exercises are 11-14, 17-22, 25, and 26. A discussion of Exercise 25 will help students 
understand the notation [ai a 2 a 3 ], {ai, a 2 , a 3 }, and Span{ai, a 2 , a 3 }. 


1. u + v = 

"-1" 

+ 

"-3" 


”-l + (-3)~ 


'-4' 


2 


-1 


_ 2 + (-!)_ 


1 


Using the definitions carefully 
~-l 
2 


u-2v = 


+ (- 2 ) 


~-3~ 


"-1" 

_1_ 

"(-2)(-3)' 


'-1 + 6' 


'5' 

-1 


2 

i 

_(— 2)(— 1)_ 


2 + 2 


4 


u - 2v = 


-f 

-2 

'-3' 

= 

'-1 + 6' 

= 

~5" 

2 


-1 


2 + 2 


4 


, or, more quickly, 

. The intermediate step is often not written. 


2. u + v — 

'3' 

+ 

" 2' 

= 

3 + 2 

= 

'5' 


2 


-1 


_2 + (—!)_ 


1 


Using the definitions carefully, 
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u-2v = 


'3' 

+ (-2) 

' 2 


'3' 

1 

' (—2X2) ' 


"3 + (-4) 


'-f 

2 

-1 


2 

l 

.(— 2)(" 1). 


2 + 2 


4 


, or, more 


quickly, 


u - 2v = 


3 

-2 

2 


3-4 


-1 

2 


-1 


2 + 2 


4 


. The 


intermediate step is often not written. 


3 . 





6 


-3 


1 


1 

so 
1 


1 

1 

UJ 

& 

1 


1 


6X[ - 3x 2 


f 

5. x 1 

-1 

+ x 2 

4 

= 

-7 

9 

— Xi 

+ 

4x 2 

= 

-7 

9 

— Xj + 4 x 2 

= 

-7 


5 


0 


-5 


1 

IT) 

1 


0 


-5 


1 

1 


_-5_ 


6xj - 3 x 2 = 1 

— jCj + 4 x 2 = -1 

5xj = -5 

Usually the intermediate steps are not displayed. 


6. x 1 


-2 

3 


+ X, 


+ X-x 


— 2x, 
3x, 


8x 2 

5x, 


-6x, 


0 


-2x, + 8x 2 + x 3 


'o’ 

0 

9 

3X[ + 5x 2 - 6x 3 


0 


-2x 2 + 8x 2 + x 3 = 0 

3x'[ + 5 x 2 - 6x 3 = 0 

Usually the intermediate steps are not displayed. 


7. See the figure below. Since the grid can be extended in every direction, the figure suggests that every 
vector in R 2 can be written as a linear combination of u and v. 

To write a vector a as a linear combination of u and v, imagine walking from the origin to a along the 
grid "streets" and keep track of how many "blocks" you travel in the u-direction and how many in the 
v-direction. 

a. To reach a from the origin, you might travel 1 unit in the u-direction and -2 units in the v-direction 
(that is, 2 units in the negative v-direction). Hence a = u - 2v. 
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b. To reach b from the origin, travel 2 units in the u-direction and -2 units in the v-direction. So 
b = 2u - 2v. Or, use the fact that b is 1 unit in the u-direction from a, so that 

b = a + u = (u- 2v) + u = 2u - 2v 

c. The vector c is —1.5 units from b in the v-direction, so 

c = b - 1.5v= (2u - 2v)- 1.5v = 2u - 3.5v 

d. The “map” suggests that you can reach d if you travel 3 units in the u-direction and -4 units in the 
v-direction. If you prefer to stay on the paths displayed on the map, you might travel from the origin 
to — 3v, then move 3 units in the u-direction, and finally move -1 unit in the v-direction. So 

d = -3v + 3u - v = 3u - 4v 
Another solution is 

d = b-2v + u = (2u - 2v) - 2v + u = 3u - 4v 



8. See the figure above. Since the grid can be extended in every direction, the figure suggests that every 
vector in R 2 can be written as a linear combination of u and v. 

w. To reach w from the origin, travel -1 units in the u-direction (that is, 1 unit in the negative 
u-direction) and travel 2 units in the v-direction. Thus, w = (-l)u + 2v, or w = 2v - u. 

x. To reach x from the origin, travel 2 units in the v-direction and -2 units in the u-direction. Thus, 
x = -2u + 2v. Or, use the fact that x is -1 units in the u-direction from w, so that 

x = w - u = (-u + 2v) - u = — 2u + 2v 

y. The vector y is 1.5 units from x in the v-direction, so 

y = x + 1.5v=(-2u + 2v)+ 1.5v = -2u + 3.5v 

z. The map suggests that you can reach z if you travel 4 units in the v-direction and -3 units in the 
u-direction. So z = 4v - 3u = -3u + 4v. If you prefer to stay on the paths displayed on the “map,” you 
might travel from the origin to -2u, then 4 units in the v-direction, and finally move -1 unit in 

the u-direction. So 

z = -2u + 4v - u = -3u + 4v 




x 2 

+ 5x 3 


z 

0 



x 2 + 5x 3 




4x, 

+ 

6x 2 


- U 


z 

0, 


4xj + 6 x 2 - 

x 3 

= 

0 

-Xi 

+ 

3x 2 


oo 


z 

0 


-Xi 

+ 3x 2 - 

1 

m 

H 

00 


0 

0 


*2 


1 

» r) 

i 


0 


0 


1 


5 


0 

4jcj 

+ 

6x 2 

+ 

-x 3 

= 

0 

, X, 

4 

+ x 2 

6 

+ x 3 

-1 

= 

0 

-*i 


3x 2 


1 

1 

00 

& 

1 


0 


-1 


3 


-8 


0 


Usually, the intermediate calculations are not displayed. 
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Note: The Study Guide says, “Check with your instructor whether you need to “show work” on a problem 
such as Exercise 9.” 


10 . 


4X| 

+ 

*2 

+ 

3x 3 

= 

9 


4x l + x 2 + 3x 3 


~9~ 

*i 

- 

7x 2 

- 

2x 3 

= 

2 , 


x i _ 2x 2 -2x 3 

= 

2 

8xj 

+ 

6x 2 

- 

5x 3 

= 

15 


8xj + 6x 2 - 

5x 3 _ 


15_ 



x 2 


3x 3 


' 9" 


'4 


r 


3" 


" 9" 

T 

+ 

-lx 2 

+ 

-2x 3 

= 

2 

, X 1 

1 

+ x 2 

-7 

+ x 3 

-2 

= 

2 

1 

OO 


1 

On 

X 

to 


-5x 3 


15 


8 


6 


-5_ 


15 


Usually, the intermediate calculations are not displayed. 


11 . The question 

Is b a linear combination of a [5 a 2 , and a 3 ? 
is equivalent to the question 

Does the vector equation x\&\ + x 2 a 2 + x 3 a 3 = b have a solution? 
The equation 



r 


" 0 " 


~ 5“ 


" 2" 


-2 

+ x 2 

1 

+ x 3 

-6 

= 

-1 


0 


2 


8 


6 


t t t t 


a | a 2 a 3 b 

has the same solution set as the linear system whose augmented matrix is 


M = 


1 

-2 

0 


0 5 

1 -6 
2 8 


2 

-1 

6 


Row reduce M until the pivot positions are visible: 



1 

(N 

in 

0 

1 


'® 0 5 2" 

M ~ 

0 14 3 

~ 

0 ® 4 3 


1 

so 

OO 

<N 

o 

1 


0 0 0 0 


The linear system corresponding to M has a solution, so the vector equation (*) has a solution, and 
therefore b is a linear combination of ai, a 2 , and a 3 . 


(*) 


12 . The equation 



r 


" 0 " 


"2" 


'-5' 


-2 

+ x 2 

5 

+ x 3 

0 

= 

11 


2 


5_ 


8 


-7_ 


t t t t 

^2 b 


has the same solution set as the linear system whose augmented matrix is 


(*) 
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M = 


1 0 
-2 5 

2 5 


2 -5 
0 11 
8 -7 


Row reduce M until the pivot positions are visible: 



“1 

0 

2 

-5' 


0) 

0 

2 

-5' 

M ~ 

0 

5 

4 

1 

~ 

0 

© 

4 

1 


0 

5 

4 

3 


0 

0 

0 

(2) 


The linear system corresponding to M has no solution, so the vector equation (*) has no solution, and 
therefore b is not a linear combination of a l5 a 2 , and a 3 . 


13. Denote the columns of A by a,, a 2 , a,. To determine if b is a linear combination of these columns, use the 
boxed fact on page 34. Row reduced the augmented matrix until you reach echelon form: 


1 

-4 

2 

3" 


© 

-A 

2 

3" 

0 

3 

5 

-7 

~ 

0 

(D 

5 

-7 

-2 

8 

-4 

-3 


0 

0 

0 

CD. 


The system for this augmented matrix is inconsistent, so b is not a linear combination of the columns 
of A. 



1 

so 

1 

<N 

1 

l 


'© -2 -6 If 

14. [a, a 2 a 3 b] = 

0 3 7 -5 

~ 

0 ® 7 -5 


1 

1 

to 

Oi 

so 

i 


1 

O 

O 

© 

1 

to 

1 


. The linear system corresponding to this 


matrix has a solution, so b is a linear combination of the columns of A. 


15. Noninteger weights are acceptable, of course, but some simple choices are Oat + 0-v 2 = 0, and 



' 7' 


'-5' 

Tvi + 0-v 2 = 

1 

, 0-Vi + l-v 2 = 

3 


-6 


0 


" 2 


"12" 

1-Vi + l-v 2 = 

4 

, Tvi - l v 2 = 

-2 


-6 


-6 


16. Some likely choices are 0-Vi + 0-v 2 = 0, and 


"3" 


"-2" 

0 

, 0-Vi + Tv 2 = 

0 

2 


3_ 

T 


" 5" 

0 

, Tvi — Tv 2 = 

0 

5 


-1 


l-Vi + l-v 2 = 
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1 

-2 

4 


“1 

-2 

4 " 


“1 

-2 

4 ' 


"© -2 

4 ' 


17. [ai a 2 b] = 

4 

-3 

1 

~ 

0 

5 

-15 

~ 

0 

1 

-3 

~ 

© 

o 

-3 

. The vector b is 


-2 

7 

h _ 


0 

3 

h + 8 


0 

3 

h + 8 


0 0 

A + 17 



in Span{a l5 a 2 } when h + 17 is zero, that is, when h = -17. 



1 

-3 

h 


"1 

-3 

h 


"© -3 

h 


18. [vi v 2 y] = 

0 

1 

-5 

~ 

0 

1 

-5 

~ 

© 

o 

— 5 

. The vector y is in 


-2 

8 

-3 


0 

2 

-3 + 2/7 


0 0 

7 + 2/7 



Span{vi, v 2 } when 7 + 2 h is zero, that is, when h = -7/2. 

19. By inspection, v 2 = (3/2)vi. Any linear combination of Vi and v 2 is actually just a multiple of Vi. For 
instance, 

a\ i + by 2 = ovi + h(3/2)v 2 = (a + 3b/2)vi 
So Span{v l5 v 2 } is the set of points on the line through Vi and 0. 


Note: Exercises 19 and 20 prepare the way for ideas in Sections 1.4 and 1.7. 


20. Spanjvi, v 2 } is a plane in R 3 through the origin, because the neither vector in this problem is a multiple 
of the other. Every vector in the set has 0 as its second entry and so lies in the vz- plane in ordinary 
3-space. So Span{v l5 v 2 } is the xz-plane. 


21. Let y = 


h 

k 


. Then [u 


v y] = 


2 

-1 


2 h 
1 k 


'0 2 h 
0 © k + h/2 


. This augmented matrix corresponds to 


a consistent system for all h and k. So y is in Spanju, v} for all h and k. 


22. Construct any 3x4 matrix in echelon form that corresponds to an inconsistent system. Perform sufficient 
row operations on the matrix to eliminate all zero entries in the first three columns. 


23. a. False. The alternative notation for a (column) vector is (-4, 3), using parentheses and commas. 

~-5~ 


b. False. Plot the points to verify this. Or, see the statement preceding Example 3. If 


the line through 


-2 

5 


and the origin, then 


-5 

2 


would have to be a multiple of 


-2 

5 


were on 


which is not 


the case. 

c. True. See the line displayed just before Example 4. 

d. True. See the box that discusses the matrix in (5). 

e. False. The statement is often true, but Spanju, v} is not a plane when v is a multiple of u, or when 
u is the zero vector. 


24. a. True. See the beginning of the subsection Vectors in R”. 

b. True. Use Fig. 7 to draw the parallelogram determined by u - v and v. 

c. False. See the first paragraph of the subsection Linear Combinations. 

d. True. See the statement that refers to Fig. 11. 

e. True. See the paragraph following the definition of Span [vi, . ... v /; }. 
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25. a. There are only three vectors in the set {ai, a 2 , a 3 }, and b is not one of them. 

b. There are infinitely many vectors in W= Span{ai, a 2 , a 3 }. To determine if b is in W, use the method 
of Exercise 13. 


10—4 4' 


1 

0 

1 
i 


'© 0 -4 4 

0 3-2 1 

~ 

0 3-21 

~ 

0 (D -2 1 

—2 6 3 -4 


1 

IT) 

1 

o 

1 


<N ' 

© 

o 

o 

1 


t t t t 


a 3 b 


The system for this augmented matrix is consistent, so b is in W. 
c. ai = lai + 0a 2 + 0a 3 . See the discussion in the text following the definition of Span {vi, ..., v p }. 


26. a. [a! a 2 a 3 b] 


Yes, b is a linear combination of the columns of A, that is, b is in W. 
b. The third column of A is in ITbecause a 3 = 0-a! + 0-a 2 + l-a 3 . 

27. a. 5vi is the output of 5 days’ operation of mine #1. 

b. The total output is jtiVi + x 2 v 2 , so jc 3 and x 2 should satisfy jcjV, + x 2 v 2 = 


■ 2 

0 

6 

10 " 


1 

0 

3 

5 " 


"l 

0 

3 

5 " 


"l 

0 

3 

5 " 

-1 

8 

5 

3 

~ 

-1 

8 

5 

3 

~ 

0 

8 

8 

8 

~ 

0 

8 

8 

8 

1 

-2 

1 

3 _ 


1 

-2 

1 

3 _ 


_0 

-2 

-2 

— 2 _ 


_0 

0 

0 

0 _ 


150 

2825 


c. [M] Reduce the augmented matrix 


" 20 

30 

150' 


550 

500 

2825_ 



1 0 1.5 

0 1 4.0 

Operate mine #1 for 1.5 days and mine #2 for 4 days. (This is the exact solution.) 


28. a. The amount of heat produced when the steam plant bums X\ tons of anthracite and x 2 tons of 
bituminous coal is 27.6xi + 30.2x 2 million Btu. 

b. The total output produced by x\ tons of anthracite and x 2 tons of bituminous coal is given by the 



"27.6" 


"30.2" 

vector jcj 

3100 

+ x 2 

6400 


250 


360 



'27.6' 


"30.2" 


162" 

c. [M] The appropriate values for X| and x 2 satisfy x. 

3100 

250 

+ X 2 

6400 

360 

— 

23,610 

1,623 


To solve, row reduce the augmented matrix: 


'27.6 

30.2 

162" 


' 1.000 

0 

3.900" 

3100 

6400 

23610 

~ 

0 

1.000 

1.800 

250 

360 

1623 


0 

0 

0 


The steam plant burned 3.9 tons of anthracite coal and 1.8 tons of bituminous coal. 
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29. The total mass is 2 + 5 + 2+1 = 10. So v = (2vi +5v 2 + 2v 3 + v 4 )/10. That is, 


1 

v = — 

r 

' 5" 


■ 4 


'-4' 


-9 


1 

1 

"10+20-8-9" 


"1.3" 

2 

-4 

+ 5 

3 

+2 

-3 

+ 

8 


—8 + 15 — 6 + 8 

— 

.9 

10 

V 

3 


-2 


-1 


_ 6 

) 

~!o 

6-10-2 + 6 


0 


30. Let m be the total mass of the system. By definition, 

1 . m, m. 

v = — (m l \ l + ■ ■ ■ + m k \ k ) = — Vl + • • • + — \ k 
m m m 

The second expression displays v as a linear combination of Vi, . . ., v*, which shows that v is in 
Span{vi, ..., Va-}. 


1 

( 

" 0 " 


"8" 


"2" 

\ 

"10/3" 

31. a. The center of mass is — 

1- 


+1- 


+ 1- 


= 


3 

V 

1 


1 


4 

/ 

2 


b. The total mass of the new system is 9 grams. The three masses added, w i, w 2 , and vv 3 , satisfy the 
equation 


( w i+l)' 


+ (w 2 +!)• 


+ ( Wj + 1 ) • 


which can be rearranged to 
"0" 


( w i + 1 )' 


1 


+ (W2 + l) 


+ 


(w 3 +l)- 


18' 

18 


and 


w. 


+ Wj 


+ w? 


12 


The condition + w 2 + w 3 = 6 and the vector equation above combine to produce a system of three 
equations whose augmented matrix is shown below, along with a sequence of row operations: 


1 

1 

1 

6“ 


"l 

1 

1 

6" 


“1 

1 

1 

6“ 






0 

8 

2 

8 

~ 

0 

8 

2 

8 

~ 

0 

8 

2 

8 






1 

1 

4 

12 


0 

0 

3 

6 


0 

0 

1 

2 











"1 

1 

0 

4" 


"1 

0 

0 

3.5" 


"1 

0 

0 

3 . 5 " 





~ 

0 

8 

0 

4 

~ 

0 

8 

0 


4 

~ 

0 

1 

0 

.5 






0 

0 

1 

2 


0 

0 

1 


2 


0 

0 

1 

2 


Answer: Add 3.5 g at (0, 1), add .5 g at (8, 1), and add 2 g at (2, 4). 


Extra problem : Ignore the mass of the plate, and distribute 6 gm at the three vertices to make the center of 
mass at (2, 2). Answer: Place 3 g at (0, 1), 1 g at (8, 1), and 2 g at (2, 4). 


32. See the parallelograms drawn on Fig. 15 from the text. Flere c\, c 2 , c 3 , and c 4 are suitable scalars. The 
darker parallelogram shows that b is a linear combination of v 3 and \ 2 , that is 

civi + c 2 V 2 + 0-v 3 = b 
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The larger parallelogram shows that b is a linear combination of Vi and V3, that is, 

C 4 V 1 + 0 -v 2 + C 3 V 3 = b 

So the equation X1V1 + x 2 v 2 + X3V3 = b has at least two solutions, not just one solution. (In fact, the 
equation has infinitely many solutions.) 



33. a. For j = 1,. . ., n, the /th entry of (u + v) + w is ( Uj + vj) + Wj. By associativity of addition in R, this 

entry equals Uj + (y,- + wj), which is the /th entry of u + (v + w). By definition of equality of vectors, 

(u + v) + w = u + (v + w). 

b. For any scalar c, the /th entry of c(u + v) is c(uj + vj), and the /th entry of cu + cx is cuj + cvj (by 
definition of scalar multiplication and vector addition). These entries are equal, by a distributive law 
in R. So c(u + v) = cu + cv. 

34. a. For/= 1,.. ., n, Uj + (-l)w 7 = (-I)m, + w 7 = 0, by properties of R. By vector equality, 

u + (-l)u = (-l)u + u = 0 . 

b. For scalars c and d, the /th entries of c(dvi) and ( cd )u are c{duj) and (cd )u„ respectively. These 
entries in R are equal, so the vectors c(</u) and (cd)u are equal. 

Note: When an exercise in this section involves a vector equation, the corresponding technology data (in the 
data files on the web) is usually presented as a set of (column) vectors. To use MATLAB or other technology, 
a student must first construct an augmented matrix from these vectors. The MATLAB note in the Study Guide 
describes how to do this. The appendices in the Study Guide give corresponding information about Maple, 
Mathematica, and the TI and HP calculators. 


1 .4 SOLUTIONS 

Notes: Key exercises are 1-20, 27, 28, 31 and 32. Exercises 29, 30, 33, and 34 are harder. Exercise 34 
anticipates the Invertible Matrix Theorem but is not used in the proof of that theorem. 

1. The matrix-vector product Ax product is not defined because the number of columns (2) in the 3x2 



'-4 

2" 


3' 

matrix 

1 

6 

does not match the number of entries (3) in the vector 

-2 


_ 0 

1 


_ 7 _ 


1.4 
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2 . The matrix-vector product Ax product is not defined because the number of columns (1) in the 3x1 

“ 2l r n 

5 

matrix 6 does not match the number of entries (2) in the vector 


3. Ax = \-4 


= 2 -4 -3 -3 = -8 + 


= 1 , and 


6 • 2 + 5 • (-3) 1 [-3' 

= (-4). 2 + (-3) -(-3) = 1 

7 • 2 + 6 • (-3) -4 


4 . Ax = 


3 -4 


8 3-4 

1 = 1 - + 1 - + 1 - 

5 1 2 

! L J L J L 


8 + 3-4 
5 + 1 + 2 


3 -A 


; - 1 + 3 - 1 + ( — 4) • l 
5-1 + 1-1 + 2-1 


5. On the left side of the matrix equation, use the entries in the vector x as the weights in a linear 
combination of the columns of the matrix A: 

r 5i r li r-8i r 4 i r-si 

5- -1- +3- -2- 

-2 -7 3 -5 16 


6. On the left side of the matrix equation, use the entries in the vector x as the weights in a linear 
combination of the columns of the matrix A: 


7. The left side of the equation is a linear combination of three vectors. Write the matrix A whose columns 
are those three vectors, and create a variable vector x with three entries: 

rr 4 i r-si r 7 n r 4 -5 71 


7 -5 


and x = x 2 . Thus the equation Ax = b is 
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For your information : The unique solution of this equation is (5, 7, 3). Finding the solution by hand 
would be time-consuming. 

Note: The skill of writing a vector equation as a matrix equation will be important for both theory and 
application throughout the text. See also Exercises 27 and 28. 


8. The left side of the equation is a linear combination of four vectors. Write the matrix A whose columns 
are those four vectors, and create a variable vector with four entries: 



, and z = 



. Then the equation Az = b 



z i 



f 4 -4 -5 3] 

z 2 


‘ 4 

o 1 

"Tt" 

<N 

1 

1 

Z 3 


13 


- Z 4_ 




For your information: One solution is (7, 3, 3, 1). The general solution is z\ = 6 + ,75z 3 - 1.25z 4 , 
z 2 = 5 - .5 z 3 - ,5 z 4 , with z 3 and z 4 free. 


9 . The system has the same solution set as the vector equation 



“3“ 


T 


~-5~ 


"9" 

x i 


+ x 2 


+ x 3 


= 



0 


l 

4 


0 


and this equation has the same solution set as the matrix equation 


“3 

1 

-5' 

T 


"9" 

0 

1 

4 

X-, 

~ 

0 




_ X 3_ 




10 . The system has the same solution set as the vector equation 


"8" 


"-1~ 


4 

5 

+ x 2 

4 

= 

1 

1 


_-3_ 


2 


and this equation has the same solution set as the matrix equation 


"8 

-f 

_ 


4 

5 

4 

x i 

— 

1 

1 

-3 

_ X 2 _ 


2 


11. To solve Ax = b, row reduce the augmented matrix [ai a 2 a 3 b] for the corresponding linear system: 


1 

2 

4 

-2“ 


“1 

2 

4 

-2 


“1 

2 

4 

-2“ 


“1 

2 

0 

-6' 


"0 o 

0 

0 " 

0 

1 

5 

2 

~ 

0 

1 

5 

2 

~ 

0 

1 

5 

2 

~ 

0 

1 

0 

-3 

~ 

© 

o 

0 

-3 

-2 

-4 

-3 

9 


0 

0 

5 

5 


0 

0 

1 

1 


0 

0 

1 

1 


1 

o 

o 

© 

1 
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x x = 0 



“ 0" 

The solution is < 

x 2 = -3 . As a vector, the solution is x = 

*2 

= 

-3 


x 3 = 1 

_ X 3_ 


1 


12. To solve Ax = b, row reduce the augmented matrix [ai a 2 a 3 b] for the corresponding linear system: 


1 

2 

1 

0 " 


"1 

2 

1 

0 " 


"1 

2 

1 

0 " 


"1 

2 

1 

0 " 

-3 

-1 

2 

1 

~ 

0 

5 

5 

1 

~ 

0 

5 

5 

1 

~ 

0 

5 

5 

1 

0 

5 

3 

-1 


0 

5 

3 

-1 


0 

0 

-2 

-2 


0 

0 

1 

1 


“1 

2 

0 

-f 


“1 

2 

0 

-1 - 


■0 0 0 3/5 ' 

0 

5 

0 

-4 

~ 

0 

1 

0 

-4/5 

~ 

0 © 0 -4/5 

0 

0 

1 

1 


0 

0 

1 

1 


0 0 © 1 



Xj = 3/5 

x i 


" 3/5 ' 

The solution is < 

x 2 = -4/5 . As a vector, the solution is x = 

x 2 

= 

-4/5 


x 3 = 1 

_ X 3_ 


1 


13. The vector u is in the plane spanned by the columns of A if and only if u is a linear combination of the 
columns of A. This happens if and only if the equation Ax = u has a solution. (See the box preceding 
Example 3 in Section 1.4.) To study this equation, reduce the augmented matrix \A u] 


3 

-5 

0 " 


1 

1 

4' 


"1 

1 

4' 



1 

4' 

-2 

6 

4 

~ 

-2 

6 

4 

~ 

0 

8 

12 

~ 

0 

® 

12 

1 

1 

4 


3 

-5 

0 


0 

-8 

-12 


0 

0 

0 


The equation Ax = u has a solution, so u is in the plane spanned by the columns of A. 
For your information : The unique solution of Ax = u is (5/2, 3/2). 


14. Reduce the augmented matrix [A u] to echelon form: 


“5 

8 

7 

2" 


"1 

3 

0 

2" 


"1 

3 

0 

2" 


TD 3 

0 

2" 

0 

1 

-1 

-3 

~ 

0 

1 

-1 

-3 

~ 

0 

1 

-1 

-3 

~ 

0 © 

-1 

-3 

1 

3 

0 

2 


_5 

8 

7 

2 


0 

-7 

7 

-8_ 


° 0 

0 

&)_ 


The equation Ax = u has no solution, so u is not in the subset spanned by the columns of A. 


15. The augmented matrix for Ax = b is 


2-1 by 

-6 3 b , 


, which is row equivalent to 


0 


-1 h, 

0 b 2 + 3 b { 


This shows that the equation Ax = b is not consistent when 3 b\ + b 2 is nonzero. The set of b for which the 
equation is consistent is a line through the origin-the set of all points (b u b 2 ) satisfying b 2 = —3b\. 


16. Row reduce the augmented matrix \A b ]: A = 


1 

-3 

-4' 


b\ 

-3 

2 

6 

,b = 

b 2 

5 

-1 

-8 


_ b 3 _ 


1 

-3 

-4 

b \ 


“l 

-3 

-4 

b \ 

-3 

2 

6 

b 2 

~ 

0 

-7 

-6 

b 2 + 3/>i 

5 

-1 

-8 

b 3 _ 


0 

14 

12 

1 

in 

1 

rn 
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“1 

-3 

1 

^t - 

1 


© 

-3 

1 

1 

0 

-7 

-6 b 2 + 36j 

= 

0 

© 

-6 b 2 + 3b ] 

0 

0 

0 b 3 - 5by + 2(b 2 + 3 by) 


0 

0 

0 by + 2b 2 + b 3 


The equation Ax = b is consistent if and only if by + 2 b 2 + /a = 0. The set of such b is a plane through the 
origin in R 3 . 

17. Row reduction shows that only three rows of A contain a pivot position: 


1 

3 

0 

3" 


"1 

3 

0 

3" 


"1 

3 

0 

3" 


© 

3 

0 

3" 

-1 

-1 

-1 

1 


0 

2 

-1 

4 


0 

2 

-1 

4 


0 

© 

-1 

4 

0 

-4 

2 

-8 


0 

-4 

2 

-8 


0 

0 

0 

0 


0 

0 

0 

© 

2 

0 

3 

-1 


0 

-6 

3 

-7_ 


0 

0 

0 

5_ 


0 

0 

0 

0 


Because not every row of A contains a pivot position, Theorem 4 in Section 1 .4 shows that the equation 
Ax = b does not have a solution for each b in R 4 . 

18. Row reduction shows that only three rows of B contain a pivot position: 


1 

3 

-2 

2 “ 


“1 

3 

-2 

2 “ 


“1 

3 

-2 

2 “ 


© 

3 

-2 

2 " 

0 

1 

1 

-5 


0 

1 

1 

-5 


0 

1 

1 

-5 


0 

® 

1 

-5 

1 

2 

-3 

7 


0 

-1 

-1 

5 


0 

0 

0 

0 


0 

0 

0 

0 

-2 

-8 

2 

-1 


0 

-2 

2 

3 


0 

0 

0 

-7_ 


0 

0 

0 

0 


Because not every row of B contains a pivot position, Theorem 4 in Section 1.4 shows that the equation 
Bx = y does not have a solution for each y in R 4 . 

19. The work in Exercise 17 shows that statement (d) in Theorem 4 is false. So all four statements in 
Theorem 4 are false. Thus, not all vectors in R 4 can be written as a linear combination of the columns 
of A. Also, the columns of A do not span R 4 . 

20. The work in Exercise 18 shows that statement (d) in Theorem 4 is false. So all four statements in 
Theorem 4 are false. Thus, not all vectors in R 4 can be written as a linear combination of the columns 
of B. The columns of B certainly do not span R 3 , because each column of B is in R 4 , not R 3 . (This 
question was asked to alert students to a fairly common misconception among students who are just 
learning about spanning.) 

2E Row reduce the matrix [vi V 2 V 3 ] to determine whether it has a pivot in each row. 


1 

0 

f 


“1 

0 

f 


“1 

0 

f 


© 

0 

f 

0 

-1 

0 


0 

-1 

0 


0 

-1 

0 


0 

© 

0 

-1 

0 

0 


0 

0 

1 


0 

0 

1 


0 

0 

© 

0 

1 

-1 


0 

1 

-1 


0 

0 

-1 


0 

0 

0 


The matrix [vi v 2 v 3 ] does not have a pivot in each row, so the columns of the matrix do not span R 4 , 
by Theorem 4. That is, {vi, v 2 , v 3 } does not span R 4 . 

Note: Some students may realize that row operations are not needed, and thereby discover the principle 
covered in Exercises 3 1 and 32. 
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22. Row reduce the matrix [vi v 2 v 3 ] to determine whether it has a pivot in each row. 


“ 0 

0 

4' 


p> 

8 -5" 

0 

-3 

-1 

~ 

0 

@ -1 

-2 

8 

-5 


0 

0 


The matrix [vi v 2 v 3 ] has a pivot in each row, so the columns of the matrix span R 4 , by Theorem 4. 
That is, {vi, v 2 , v 3 } spans R 4 . 

23. a. False. See the paragraph following equation (3). The text calls Ax = b a matrix equation. 

b. True. See the box before Example 3. 

c. False. See the warning following Theorem 4. 

d. True. See Example 4. 

e. True. See parts (c) and (a) in Theorem 4. 

f. True. In Theorem 4, statement (a) is false if and only if statement (d) is also false. 

24. a. True. This statement is in Theorem 3. Flowever, the statement is true without any "proof' because, by 

definition, Ax is simply a notation for _v i a i + • • • +x„a,„ where ai, ..., a„ are the columns of A. 

b. True. See Example 2. 

c. True, by Theorem 3. 

d. True. See the box before Example 2. Saying that b is not in the set spanned by the columns of A is the 
same a saying that b is not a linear combination of the columns of A. 

e. False. See the warning that follows Theorem 4. 

f. True. In Theorem 4, statement (c) is false if and only if statement (a) is also false. 

25. By definition, the matrix-vector product on the left is a linear combination of the columns of the matrix, 
in this case using weights -3, -1, and 2. So C\ = -3, c 2 = -1, and c 3 = 2. 


26. The equation in x\ and x 2 involves the vectors u, v, and w, and it may be viewed as 


u v 


= w. By definition of a matrix-vector product, jc,u + x 2 v = w. The stated fact that 


3u - 5v - w = 0 can be rewritten as 3u - 5v = w. So, a solution is x\ = 3, x 2 = -5. 


27. Place the vectors qi, q 2 , and q 3 into the columns of a matrix, say, Q and place the weights x h x 2 , and x 3 
into a vector, say, x. Then the vector equation becomes 


Qx = v, where Q = [q, q 2 q 3 ] and x = 


Note: If your answer is the equation Ax = b, you need to specify what A and b are. 

28. The matrix equation can be written as ciVi + c 2 v 2 + c 3 v 3 + C4V4 + C5V5 = V6, where 
ci = -3, c 2 = 2, c 3 = 4, C 4 = —1 , C 5 = 2, and 



“-3‘ 


“ 5" 


'-4' 


■ 9" 


“ 7' 


" 8 " 

v i = 


, v 2 = 


>^3 = 


>v 4 = 


,V 5 = 


,V 6 = 



_ 5_ 


8 

1 

-2 


-4 


-1 
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29. Start with any 3x3 matrix B in echelon form that has three pivot positions. Perform a row operation 

(a row interchange or a row replacement) that creates a matrix A that is not in echelon form. Then A has 
the desired property. The justification is given by row reducing A to B, in order to display the pivot 
positions. Since A has a pivot position in every row, the columns of A span R 3 , by Theorem 4. 

30. Start with any nonzero 3x3 matrix B in echelon form that has fewer than three pivot positions. Perform 

a row operation that creates a matrix A that is not in echelon form. Then A has the desired property. Since 
A does not have a pivot position in every row, the columns of A do not span R 3 , by Theorem 4. 

31. A 3x2 matrix has three rows and two columns. With only two columns, A can have at most two pivot 
columns, and so A has at most two pivot positions, which is not enough to fill all three rows. By 
Theorem 4, the equation Ax = b cannot be consistent for all b in R 3 . Generally, if A is an mxn matrix 
with m > 77, then A can have at most n pivot positions, which is not enough to fill all m rows. Thus, the 
equation Ax = b cannot be consistent for all b in R 3 . 

32. A set of three vectors in cannot span R 4 . Reason: the matrix A whose columns are these three vectors has 
four rows. To have a pivot in each row, A would have to have at least four columns (one for each pivot), 
which is not the case. Since A does not have a pivot in every row, its columns do not span R 4 , by 
Theorem 4. In general, a set of n vectors in R'" cannot span R"' when n is less than m. 


33. 


If the equation Ax = b has a unique solution, then the associated system of equations does not have any 
free variables. If every variable is a basic variable, then each column of A is a pivot column. So the 


reduced echelon form of A must be 


®0 O' 
0 ® 0 
0 0 ® 
0 0 0 


Note: Exercises 33 and 34 are difficult in the context of this section because the focus in Section 1.4 is on 
existence of solutions, not uniqueness. However, these exercises serve to review ideas from Section 1.2, and 
they anticipate ideas that will come later. 


34. 


If the equation Ax = b has a unique solution, then the associated system of equations does not have any 
free variables. If every variable is a basic variable, then each column of A is a pivot column. So the 


reduced echelon form of A must be 


(Do o - 
o © o 
o o Q) 


Now it is clear that A has a pivot position in each row. 


By Theorem 4, the columns of A span R 3 . 


35. Given Axi = jq and Ax 2 = y 2 , you are asked to show that the equation Ax = w has a solution, where 
w = yi + y 2 . Observe that w = Ax t + Ax 2 and use Theorem 5(a) with Xj and x 2 in place of u and v, 
respectively. That is, w = AX| + Ax 2 = A(x, + x 2 ). So the vector x = x t + x 2 is a solution of w = Ax. 


36. Suppose that y and z satisfy Ay = z. Then 4z = 4Ay. By Theorem 5(b), 4Ay = A(4y). So 4z = A(4y), 
which shows that 4y is a solution of Ax = 4z. Thus, the equation Ax = 4z is consistent. 
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37. [M] 
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or, approximately 
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have a pivot in every row, so its columns do not span R 4 , by Theorem 4. 


to three significant figures. The original matrix does not 


38. [M] 


5 

-7 

-4 

9" 


“5 

-7 

-4 

9“ 


© 

-7 

-4 

9" 

6 

-8 

-7 

5 


0 

2/5 

-11/5 

-29/5 


0 

@) 

-11/5 

-29/5 

4 

-4 

-9 

-9 


0 

8/5 

-29/5 

-81/5 


0 

0 

© 

7 

-9 

11 

16 

7_ 


0 

-8/5 

44/5 

116/5 


0 

0 

* 

* 


MATLAB shows starred entries for numbers that are essentially zero (to many decimal places). So, with 
pivots only in the first three rows, the original matrix has columns that do not span R 4 , by Theorem 4. 
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The original matrix has a pivot in every row, so its columns span R 4 , by Theorem 4. 
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The original matrix has a pivot in every row, so its columns span R 4 , by Theorem 4. 


41. [M] Examine the calculations in Exercise 39. Notice that the fourth column of the original matrix, say A, 
is not a pivot column. Let A 0 be the matrix formed by deleting column 4 of A, let B be the echelon form 
obtained from A, and let B° be the matrix obtained by deleting column 4 of B. The sequence of row 
operations that reduces A to B also reduces A 0 to B°. Since B° is in echelon form, it shows that A° has a 
pivot position in each row. Therefore, the columns of A° span R 4 . 

It is possible to delete column 3 of A instead of column 4. In this case, the fourth column of A becomes a 
pivot column of A 0 , as you can see by looking at what happens when column 3 of# is deleted. For later 
work, it is desirable to delete a nonpivot column. 
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Note: Exercises 41 and 42 help to prepare for later work on the column space of a matrix. (See Section 2.9 or 
4.6.) The Study Guide points out that these exercises depend on the following idea, not explicitly mentioned 
in the text: when a row operation is performed on a matrix A, the calculations for each new entry depend only 
on the other entries in the same column. If a column of A is removed, forming a new matrix, the absence of 
this column has no affect on any row-operation calculations for entries in the other columns of A. (The 
absence of a column might affect the particular choice of row operations performed for some purpose, but that 
is not being considered here.) 

42. [M] Examine the calculations in Exercise 40. The third column of the original matrix, say A, is not a 
pivot column. Let A 0 be the matrix formed by deleting column 3 of A, let B be the echelon form obtained 
from A, and let B" be the matrix obtained by deleting column 3 of B. The sequence of row operations that 
reduces A to B also reduces A° to B°. Since B° is in echelon form, it shows that A° has a pivot position in 
each row. Therefore, the columns of A° span R 4 . 

It is possible to delete column 2 of A instead of column 3. (See the remark for Exercise 41.) Elowever, 
only one column can be deleted. If two or more columns were deleted from A, the resulting matrix would 
have fewer than four columns, so it would have fewer than four pivot positions. In such a case, not every 
row could contain a pivot position, and the columns of the matrix would not span R 4 , by Theorem 4. 

Notes: At the end of Section 1.4, the Study Guide gives students a method for learning and mastering linear 
algebra concepts. Specific directions are given for constructing a review sheet that connects the basic 
definition of “span” with related ideas: equivalent descriptions, theorems, geometric interpretations, special 
cases, algorithms, and typical computations. 1 require my students to prepare such a sheet that reflects their 
choices of material connected with “span”, and I make comments on their sheets to help them refine their 
review. Later, the students use these sheets when studying for exams. 

The MATLAB box for Section 1.4 introduces two useful commands gauss and bgauss that allow a 
student to speed up row reduction while still visualizing all the steps involved. The command 
B = gauss (A, 1) causes MATLAB to find the left-most nonzero entry in row 1 of matrix A, and use that 
entry as a pivot to create zeros in the entries below, using row replacement operations. The result is a matrix 
that a student might write next to A as the first stage of row reduction, since there is no need to write a new 
matrix after each separate row replacement. I use the gauss command frequently in lectures to obtain an 
echelon form that provides data for solving various problems. For instance, if a matrix has 5 rows, and if row 
swaps are not needed, the following commands produce an echelon form of A: 

B = gauss (A, 1), B = gauss (B, 2), B = gauss (B, 3), B = gauss (B, 4) 

If an interchange is required, 1 can insert a command such as B = swap (B, 2 , 5) . The command bgauss 
uses the left-most nonzero entry in a row to produce zeros above that entry. This command, together with 
scale, can change an echelon form into reduced echelon form. 

The use of gauss and bgauss creates an environment in which students use their computer program 
the same way they work a problem by hand on an exam. Unless you are able to conduct your exams in a 
computer laboratory, it may be unwise to give students too early the power to obtain reduced echelon forms 
with one command — they may have difficulty performing row reduction by hand during an exam. Instructors 
whose students use a graphic calculator in class each day do not face this problem. In such a case, you may 
wish to introduce rref earlier in the course than Chapter 4 (or Section 2.8), which is where 1 finally allow 
students to use that command. 


1.5 SOLUTIONS 


Notes: The geometry helps students understand Span{u, v}, in preparation for later discussions of subspaces. 
The parametric vector form of a solution set will be used throughout the text. Figure 6 will appear again in 
Sections 2.9 and 4.8. 
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For solving homogeneous systems, the text recommends working with the augmented matrix, although no 
calculations take place in the augmented column. See the Study Guide comments on Exercise 7 that illustrate 
two common student errors. 

All students need the practice of Exercises 1-14. (Assign all odd, all even, or a mixture. If you do not 
assign Exercise 7, be sure to assign both 8 and 10.) Otherwise, a few students may be unable later to find a 
basis for a null space or an eigenspace. Exercises 29-34 are important. Exercises 33 and 34 help students later 
understand how solutions of Ax = 0 encode linear dependence relations among the columns of A. Exercises 
35-38 are more challenging. Exercise 37 will help students avoid the standard mistake of forgetting that 
Theorem 6 applies only to a consistent equation Ax = b. 


1. Reduce the augmented matrix to echelon form and circle the pivot positions. If a column of the 

coefficient matrix is not a pivot column, the corresponding variable is free and the system of equations 
has a nontrivial solution. Otherwise, the system has only the trivial solution. 
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The variable x 3 is free, so the system has a nontrivial solution. 
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There is no free variable; the system has only the trivial solution. 
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The variable x 3 is free; the system has nontrivial solutions. 


An alert student will realize that row operations are unnecessary. With only two equations, there can be 
at most two basic variables. One variable must be free. Refer to Exercise 3 1 in Section 1 .2. 
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. x 3 is a free variable; the system has 


nontrivial solutions. As in Exercise 3, row operations are unnecessary. 
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0 - 5x 3 = 0 

(xfi + 2x 3 = 0 . The variable x 3 is free, X\ = 5x 3 , and X2 = - 2 x 3 . 
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In parametric vector form, the general solution is x = 
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(xj) + 4 x 3 = 0 

(ft) - 3x 3 = 0 . The variable X 3 is free, x\ = - 4 x 3 , and X 2 = 3 x 3 . 
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The basic variables are Xi and x 2 , with x 3 and x 4 free. Next, x\ = -9x 3 + 8x 4 , and x 2 = 4x 3 - 5x 4 . The 
general solution is 
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The basic variables are Xi and x 2 , withx 3 and x 4 free. Next, xi = 5x3 
solution in parametric vector form is 


7x 4 and x 2 = -2x3 + 6x 4 . The general 
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The solution is Xi = 3x 2 - 2x 3 , with x 2 and x 3 free. In parametric vector form, 
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The only basic variable is Xi, so x 2 , x 3 , and x 4 are free. (Note that x 3 is not zero.) Also, Xi = 3x 2 + 4x 4 . The 
general solution is 
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©- 4x 2 + 5 x 6 = 0 

(x7) - x 6 = 0 

v — . The basic variables are X\, x 3 , and x 5 . The remaining variables are free. 

© - 4x 6 = 0 

0 = 0 


In particular, X 4 is free (and not zero as some may assume). The solution is xi = 4 x 2 - 5x6, X 3 = X 6 , 
x 5 = 4x6, with X2, X4, and X6 free. In parametric vector form, 
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Note: The Study Guide discusses two mistakes that students often make on this type of problem. 
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The basic variables are x\, x 3 , and x 6 ; the free variables are x 2 , x 4 , and x 5 . The general solution is 
Xi = -5x2 - 8x4 - X5, x 3 = 7x4 - 4x5, and X6 = 0. In parametric vector form, the solution is 
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13 . To write the general solution in parametric vector form, pull out the constant terms that do not involve 
the free variable: 
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Geometrically, the solution set is the line through 
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14 . To write the general solution in parametric vector form, pull out the constant terms that do not involve 
the free variable: 
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The solution set is the line through p in the direction of q. 


15 . Row reduce the augmented matrix for the system: 
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Thus Xi = -2 + 5x 3 , x 2 = 1 - 2x 3 , and x 3 is free. In parametric vector form, 
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The solution set is the line through 
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, parallel to the line that is the solution set of the homogeneous 


system in Exercise 5 . 

16 . Row reduce the augmented matrix for the system: 


1 

3 

-5 

4 


"1 

3 

-5 

4' 


"1 

3 

-5 

4' 


'0 

0 

4 

-5' 

1 

4 

-8 

7 

~ 

0 

1 

-3 

3 

~ 

0 

1 

-3 

3 

~ 

0 

0 

-3 

3 

-3 

-7 

9 

-6 


0 

2 

-6 

6 


0 

0 

0 

0 


0 

0 

0 

0 


(xj) + 4 x 3 = -5 

@ - 3 x 3 = 3 . Thus Xi = -5 - 4x3, X2 = 3 + 3x3, and X3 is free. In parametric vector form, 
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The solution set is the line through 
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, parallel to the line that is the solution set of the homogeneous 


system in Exercise 6. 


17 . Solve Xi + 9x2 - 4x3 = -2 for the basic variable: x\ = -2 - 9 x 2 + 4x3, with X2 and X3 free. In vector form, 
the solution is 
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The solution of Xi + 9x2 - 4x3 = 0 is x\ = - 9 x 2 + 4x3, with X2 and X3 free. In vector form, 
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The solution set of the homogeneous equation is the plane through the origin in R 3 spanned by 
u and v. The solution set of the nonhomogeneous equation is parallel to this plane and passes through the 


point p = 


-2 

0 

0 


18 . Solve Xi - 3x2 + 5x3 = 4 for the basic variable: x\ = 4 + 3x2 - 5x3, with X2 and X3 free. In vector form, the 
solution is 


Xj 

*2 

x 3 


4 + 3x 2 -5x 3 


' 4' 


3x 2 


1 

1 

s/i 
1 


' 4' 


“ 3“ 


'-5' 

*2 

= 

0 

+ 

*2 

+ 

0 

= 

0 

+ x 2 

1 

+ x 3 

0 

*3 


0 


0 


. X 3 


0 


0 


1 


X = 
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The solution of jci - 3x 2 + 5x 3 = 0 is X\ = 3x 2 - 5x 3 , with x 2 and x 3 free. In vector form, 



*i 


3x 2 - 5x 3 


3x 2 


1 

1 

X 

UJ 

1 


" 3" 


'-5' 

X = 

*2 

= 

*2 

= 

*2 

+ 

0 

= *2 

1 

+ x 3 

0 


_ X 3_ 




0 


. *3 


0 


1 


1 X 2 U + X 3 V 


The solution set of the homogeneous equation is the plane through the origin in R 3 spanned by u and v. 
The solution set of the nonhomogeneous equation is parallel to this plane and passes through the 
4' 


point p = 


19. The line through a parallel to b can be written as x = a + t b, where t represents a parameter: 



x i 


"-2“ 


“-5“ 

i 

<N 

1 

II 

x = 


= 


+ t 


, or < 


_ X 2 _ 


_ 0 


3 

[x, =3 1 


20. The line through a parallel to b can be written as x = a + db, where t represents a parameter: 



Xj 


3" 


"-7" 

fx, = 3 -It 

x = 


= 


+ t 


, or < 


_x 2 _ 


-4 


8 

OC 

+ 

1 

II 

<N 

X 


. 2 

21. The line through p and q is parallel to q - p. So, given p = | _ 

I , and write the line as x = p + t(q - p) = 


and q = 



'-3-2' 


r-5i 

q-p = 


— 

1 

so 

1 


2 

-5 


+ t 


—6 

22. The line through p and q is parallel to q - p. So, given p = ^ 

"0 — (— 6)1 r 6l 

q - p = = , and write the line as x = p + t(q - p) 


and q = 


-3 

1 

'-5 

6 

0" 

-4 


, form 


, form 


-6 

3 


+ t 


6 

-7 


Note: Exercises 21 and 22 prepare for Exercise 27 in Section 1.8. 

23. a. True. See the first paragraph of the subsection titled Homogeneous Linear Systems. 

b. False. The equation Ax = 0 gives an implicit description of its solution set. See the subsection entitled 
Parametric Vector Form. 

c. False. The equation Ax = 0 always has the trivial solution. The box before Example 1 uses the word 
nontrivial instead of trivial. 

d. False. The line goes through p parallel to v. See the paragraph that precedes Fig. 5. 

e. False. The solution set could be emptyl The statement (from Theorem 6) is true only when there 
exists a vector p such that Ap = b. 

24. a. False. A nontrivial solution of Ax = 0 is any nonzero x that satisfies the equation. See the 

sentence before Example 2. 

b. True. See Example 2 and the paragraph following it. 
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c. True. If the zero vector is a solution, then b = Ax - AO = 0. 

d. True. See the paragraph following Example 3. 

e. False. The statement is true only when the solution set of Ax = 0 is nonempty. Theorem 6 applies 
only to a consistent system. 

25. Suppose p satisfies Ax = b. Then A p = b. Theorem 6 says that the solution set of Ax = b equals the 
set S ={w : w = p + v h for some Vh such that A\ h = 0} . There are two things to prove: (a) every vector 
in S satisfies Ax = b, (b) every vector that satisfies Ax = b is in S. 

a. Let w have the form w = p + v h , where A v h = 0. Then 

Aw = A ( p + v h ) = Ap + Av h . By Theorem 5(a) in section 1 .4 

= b + 0 = b 

So every vector of the form p + v h satisfies Ax = b. 

b. Now let w be any solution of Ax = b, and set v h = w - p. Then 

Ax h = A( w - p) = Aw -Ap=b-b=0 

So v h satisfies Ax = 0. Thus every solution of Ax = b has the form w = p + v h . 

26. ( Geometric argument using Theorem 6.) Since Ax = b is consistent, its solution set is obtained by 
translating the solution set of Ax = 0, by Theorem 6. So the solution set of Ax = b is a single vector if 
and only if the solution set of Ax = 0 is a single vector, and that happens if and only if Ax = 0 has only 
the trivial solution. 

{Proof using free variables.) If Ax = b has a solution, then the solution is unique if and only if there 
are no free variables in the corresponding system of equations, that is, if and only if every column of A is 
a pivot column. This happens if and only if the equation Ax = 0 has only the trivial solution. 

27. When A is the 3><3 zero matrix, even’ x in R 3 satisfies Ax = 0. So the solution set is all vectors in R 3 . 

28. No. If the solution set of Ax = b contained the origin, then 0 would satisfy A0= b, which is not true 
since b is not the zero vector. 

29. a. When A is a 3 x3 matrix with three pivot positions, the equation Ax = 0 has no free variables and 

hence has no nontrivial solution. 

b. With three pivot positions, A has a pivot position in each of its three rows. By Theorem 4 in 
Section 1.4, the equation Ax = b has a solution for every possible b. The term "possible" in the 
exercise means that the only vectors considered in this case are those in R 3 , because A has three rows. 

30. a. When A is a 3x3 matrix with two pivot positions, the equation Ax = 0 has two basic variables and 

one free variable. So Ax = 0 has a nontrivial solution, 
b. With only two pivot positions, A cannot have a pivot in every row, so by Theorem 4 in Section 1.4, 
the equation Ax = b cannot have a solution for every possible b (in R 3 ). 

31. a. When A is a 3x2 matrix with two pivot positions, each column is a pivot column. So the equation 

Ax = 0 has no free variables and hence no nontrivial solution. 

b. With two pivot positions and three rows, A cannot have a pivot in every row. So the equation Ax = b 
cannot have a solution for every possible b (in R 3 ), by Theorem 4 in Section 1.4. 

32. a. When A is a 2x4 matrix with two pivot positions, the equation Ax = 0 has two basic variables and 

two free variables. So Ax = 0 has a nontrivial solution. 

b. With two pivot positions and only two rows, A has a pivot position in every row. By Theorem 4 in 
Section 1.4, the equation Ax = b has a solution for every possible b (in R 2 ). 
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-2 -6 

33. Look at Xj 7 + x 2 21 and notice that the second column is 3 times the first. So suitable values for 



X] and X 2 would be 3 and -1 respectively. (Another pair would be 6 and -2, etc.) Thus x = 
satisfies Ax = 0. 



34. Inspect how the columns a, and a 2 of A are related. The second column is -3/2 times the first. Put 


another way, 3a! + 2a 2 = 0. Thus satisfies Ax = 0. 


Note: Exercises 33 and 34 set the stage for the concept of linear dependence. 

35. LookforA = [ai a 2 a 3 ] such that Taj + la 2 + l-a 3 = 0. That is, construct A so that each row sum (the 
sum of the entries in a row) is zero. 

36. Look for A = [ai a 2 a 3 ] such that 1 -aj - 2-a 2 + l a 3 = 0. That is, construct A so that the sum of the 
first and third columns is twice the second column. 

37. Since the solution set of Ax = 0 contains the point (4,1), the vector x = (4,1) satisfies Ax = 0. Write this 
equation as a vector equation, using ai and a 2 for the columns of A: 

4-ai + la 2 = 0 

Then a 2 = -4ai. So choose any nonzero vector for the first column of A and multiply that column by - 4 
to get the second column of A. For example, set A = 

Finally, the only way the solution set of Ax = b could not be parallel to the line through (1,4) and the 
origin is for the solution set of Ax = b to be empty. This does not contradict Theorem 6, because that 
theorem applies only to the case when the equation Ax = b has a nonempty solution set. For b, take any 
vector that is not a multiple of the columns of A. 

Note: In the Study Guide, a “Checkpoint” for Section 1.5 will help students with Exercise 37. 

38. No. If Ax = y has no solution, then A cannot have a pivot in each row. Since A is 3><3, it has at most two 
pivot positions. So the equation Ax = z for any z has at most two basic variables and at least one free 
variable. Thus, the solution set for Ax = z is either empty or has infinitely many elements. 

39. If u satisfies Ax = 0, then Au = 0. For any scalar c, Theorem 5(b) in Section 1 .4 shows that A(cu) = 

cAu = c0 = 0. 

40. Suppose Au = 0 and Av = 0. Then, since A(u + v) = Au + Av by Theorem 5(a) in Section 1 .4, 

A(u + v) = Au + Av = 0 + 0 = 0. 

Now, let c and d be scalars. Using both parts of Theorem 5, 

A(cu + d\) = A(cu) + A(d\) = cAu + dAv = cO + dO = 0. 

Note: The MATLAB box in the Study Guide introduces the zeros command, in order to augment a matrix 
with a column of zeros. 
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1.6 SOLUTIONS 


1. Fill in the exchange table one column at a time. The entries in a column describe where a sector's output 
goes. The decimal fractions in each column sum to 1 . 


Distribution of 
Output From: 
Goods Services 


Purchased by: 

output -l 

4 

input 


.2 

.7 

— > 

Goods 

.8 

.3 

— > 

Services 


Denote the total annual output ( in dollars) of the sectors by pc, and ps- From the first row, the total input 
to the Goods sector is .2 p G + .7 ps. The Goods sector must pay for that. So the equilibrium prices must 
satisfy 

income expenses 

Pg = - 2 Pg+- 7 Ps 

From the second row, the input (that is, the expense) of the Services sector is .8 p G + 3 p s . 

The equilibrium equation for the Services sector is 

income expenses 

Ps = -%Pg + -IPs 

Move all variables to the left side and combine like terms: 

■%Pg - ^Ps = 0 


-.8p a + .7 p s = 0 
Row reduce the augmented matrix: 


1 

OO 

J 

o 
1 


".8 -.7 0“ 


"0 -.875 0" 

-.8 .7 0 


1 

o 

o 

o 

1 


0 0 0 


The general solution is pc = -875 ps, with p s free. One equilibrium solution is ps = 1000 and pa = 875. 
If one uses fractions instead of decimals in the calculations, the general solution would be written 
p G = (7/8) ps, and a natural choice of prices might be /; s = 80 and p G = 70. Only the ratio of the prices 
is important: p G = .875 ps- The economic equilibrium is unaffected by a proportional change in prices. 

2. Take some other value for p s , say 200 million dollars. The other equilibrium prices are then 

p c = 188 million, p E =170 million. Any constant nonnegative multiple of these prices is a set of 
equilibrium prices, because the solution set of the system of equations consists of all multiples of one 
vector. Changing the unit of measurement to, say, European euros has the same effect as multiplying 
all equilibrium prices by a constant. The ratios of the prices remain the same, no matter what currency 
is used. 

3. a. Fill in the exchange table one column at a time. The entries in a column describe where a sector’s 

output goes. The decimal fractions in each column sum to 1. 
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Distribution of Output From: 


Purchased 

Chemicals 

Fuels 

Machinery 


by: 

output i 

4 

4 

input 


.2 

.8 

.4 

► 

Chemicals 

.3 

.1 

.4 

► 

Fuels 

.5 

.1 

.2 

► 

Machinery 


b. Denote the total annual output (in dollars) of the sectors by pc,Pv, and p M - From the first row of the 
table, the total input to the Chemical & Metals sector is .2 p c + .8 p v + .4 p M . So the equillibrium 
prices must satisfy 

income expenses 

Pc = - 2 .Pc + a Pf + a Pm 

From the second and third rows of the table, the income/expense requirements for the Fuels & Power 
sector and the Machinery sector are, respectively, 

Pf= 3 Pc +a Pf +a Pm 
Pm = a Pc +a Pf+- 2 Pm 

Move all variables to the left side and combine like terms: 

.Sp c -.Sp F -.4p M =0 
-.3 Pc + -9 p F - A p M = 0 
-,5p c -.\p r + .8p M =0 

c. [M] You can obtain the reduced echelon form with a matrix program. Actually, hand calculations are 
not too messy. To simplify the calculations, first scale each row of the augmented matrix by 10, then 
continue as usual. 


" 8 

-8 

-4 

0 " 


1 

-1 

-.5 

0 " 


"1 

-1 

-.5 

0 " 

-3 

9 

-4 

0 

~ 

-3 

9 

-4 

0 

~ 

0 

6 

-5.5 

0 

-5 

-1 

8 

0 


-5 

-1 

8 

0 


0 

-6 

5.5 

0 


“1 

-1 

-.5 

0“ 


© o 

-1.417 

0“ 

The number of decimal 

0 

1 

-.917 

0 

~ 

o © 

-.917 

0 

places displayed is 

0 

0 

0 

0 


0 0 

0 

0 

somewhat arbitrary. 


The general solution is pc = 1.417 p M , Pv = .917 p M , with p M free. If p M is assigned the value 100, then 
pc = 141.7 and pv = 91.7 . Note that only the ratios of the prices are determined. This makes sense, for 
if the were converted from, say, dollars to yen or Euros, the inputs and outputs of each sector would 
still balance. The economic equilibrium is not affected by a proportional change in prices. 
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4. a. Fill in the exchange table one column at a time. The entries in each column must sum to 1. 
Distribution of Output From: 


Agric . 

output i- 

Energy 

Manuf . 

Transp. 

input 

Purchased by : 

.65 

.30 

.30 

.20 

— > 

Agric. 

.10 

.10 

.15 

.10 

— > 

Energy 

.25 

.35 

.15 

.30 

-4 

Manuf. 

0 

.25 

.40 

.40 

— > 

Transp. 


b. Denote the total annual output of the sectors by p A , Pe, Pm, and p T , respectively. From the first row of 
the table, the total input to Agriculture is .65/? A + 30p E + ,30/?m + .20 p-\ . So the equilibrium prices 
must satisfy 

income expenses 

Pa = -65p A + .30/? e + .30/? m + 20p E 

From the second, third, and fourth rows of the table, the equilibrium equations are 
Pe = ■ 1 0/? A + • 1 0p E + . 1 5p M + . 1 0p T 

Pm = 25p A +35p E +.\5p M +30p T 

Pi = 25 p E + A0p u + A0p T 

Move all variables to the left side and combine like terms: 

35 p A -30p E -20p M -20p T =0 
-IO^a +-90 p E -A5p M -A0p T =0 
-25p A -35p E + .85/? M -.30/? x =0 
-.25 p E - .40 p u + .60 p T = 0 

Use gauss, bgauss, and scale operations to reduce the augmented matrix to reduced echelon form 


".35 

-.3 

-.3 

-.2 

O' 


'.35 

-.3 

0 

-.55 

0 " 


'© 

0 

0 

-.71 

0 " 

0 

.81 

-.24 

-.16 

0 


0 

.81 

0 

-.43 

0 


0 

® 

0 

-.53 

0 

0 

0 

1.0 

-1.17 

0 


0 

0 

1 

-1.17 

0 


0 

0 

® 

-1.17 

0 

0 

0 

0 

0 

0 


0 

0 

0 

0 

0 


0 

0 

0 

0 

0 


Scale the first row and solve for the basic variables in terms of the free variable pj, and obtain 
Pa ~ 2.03 pj, p E = ,53/>i , and p\n = 1.1 lp-\. The data probably justifies at most two significant figures, 
so take p T = 100 and round off the other prices to p A = 200, p E = 53, and p M = 120. 


5. The following vectors list the numbers of atoms of boron (B), sulfur (S), hydrogen (FI), and oxygen (O): 

boron 
sulfur 
hydrogen 
oxygen 


B 2 S 3 : 


" 2 " 


" 0 " 


"f 


" 0 " 

3 

, H 2 0: 

0 

, H 3 BO 3 : 

0 

, FES: 

1 

0 


2 

3 


2 

0 


1 


_3_ 


0 


The coefficients in the equation X 1 B 2 S 3 + H 2 0 — > x 3 H 3 BO 3 + X 4 -H 2 S satisfy 
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“ 2 “ 


“ 0 “ 


"f 


“0" 


3 


0 


0 


1 

x t 


+ x 2 


= x 3 


+ x 4 



0 


2 


3 


2 


0 


1 


3 


0 


Move the right terms to the left side (changing the sign of each entry in the third and fourth vectors) and 
row reduce the augmented matrix of the homogeneous system: 


“2 

0 

-1 

0 

0“ 


“2 

0 

-1 

0 

0“ 


“2 

0 

-1 

0 

0“ 


“2 

0 

-1 

0 

0 " 

3 

0 

0 

-1 

0 


0 

0 

3/2 

-1 

0 


0 

1 

-3 

0 

0 


0 

1 

-3 

0 

0 

0 

2 

-3 

-2 

0 


0 

2 

-3 

-2 

0 


0 

0 

3/2 

-1 

0 


0 

0 

3/2 

-1 

0 

0 

1 

-3 

0 

0 


0 

1 

-3 

0 

0 


0 

2 

-3 

2 

0 


0 

0 

3 

2 

0 


"2 

0 

-1 

0 

0 " 


"2 

0 

0 

-2/3 

0 " 


"1 

0 

0 

-1/3 

0 " 

0 

1 

-3 

0 

0 


0 

1 

0 

-2 

0 


0 

1 

0 

-2 

0 

0 

0 

1 

-2/3 

0 


0 

0 

1 

-2/3 

0 


0 

0 

1 

-2/3 

0 

0 

0 

3 

-2 

0 


0 

0 

0 

0 

0 


0 

0 

0 

0 

0 


The general solution is jti = (1/3) x 4 , x 2 = 2x 4 , x 3 = (2/3) x 4 , with x 4 free. Take x 4 = 3. Then Xi = 1, 
x 2 = 6, and x 3 = 2. The balanced equation is 

B 2 S 3 + 6H 2 0 -a 2H 3 B0 3 + 3H 2 S 


6. The following vectors list the numbers of atoms of sodium (Na), phosphorus (P), oxygen (O), 
barium (Ba), and nitrogen(N): 


Na 3 P0 4 : 


“3“ 


“ 0 “ 


“ 0 “ 


T 

1 


0 


2 


0 

4 

, Ba(N0 3 ) 2 : 

6 

, Ba 3 (P0 4 ) 2 : 

8 

, NaN0 3 : 

3 

0 


1 


3 


0 

0 


2 


0 


1 


sodium 

phosphorus 

oxygen 

barium 

nitrogen 


The coefficients in the equation xi-Na 3 P0 4 + x 2 -Ba(N0 3 ) 2 — > x 3 Ba 3 (P0 4 ) 2 + x 4 -NaN0 3 satisfy 


3~ 


“ 0 “ 


“ 0 “ 


"f 

1 


0 


2 


0 

4 

+ x 2 

6 

= x 3 

8 

+ x 4 

3 

0 


1 


3 


0 

0 


2 


0 


1 


Move the right terms to the left side (changing the sign of each entry in the third and fourth vectors) and 
row reduce the augmented matrix of the homogeneous system: 


"3 

0 

0 

-1 

0 " 


"1 

0 

-2 

0 

0 " 


"1 

0 

-2 

0 

0 " 


"1 

0 

-2 

0 

0 " 

1 

0 

-2 

0 

0 


3 

0 

0 

-1 

0 


0 

0 

6 

-1 

0 


0 

1 

-3 

0 

0 

4 

6 

-8 

-3 

0 

~ 

4 

6 

-8 

-3 

0 

~ 

0 

6 

0 

-3 

0 

~ 

0 

6 

0 

-3 

0 

0 

1 

-3 

0 

0 


0 

1 

-3 

0 

0 


0 

1 

-3 

0 

0 


0 

0 

6 

-1 

0 

0 

2 

0 

-1 

0 


0 

2 

0 

-1 

0 


0 

2 

0 

-1 

0 


0 

2 

0 

-1 

0 
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"1 

0 

2 

0 

0 " 


"1 

0 

-2 

0 

0 " 


"1 

0 

0 

-1/3 

0 " 

0 

1 

-3 

0 

0 


0 

1 

-3 

0 

0 


0 

1 

0 

-1/2 

0 

0 

0 

18 

-3 

0 

~ 

0 

0 

1 

-1/6 

0 

~ 

0 

0 

1 

-1/6 

0 

0 

0 

6 

-1 

0 


0 

0 

0 

0 

0 


0 

0 

0 

0 

0 

0 

0 

6 

-1 

0 


0 

0 

0 

0 

0 


0 

0 

0 

0 

0 


The general solution is jti = ( 1 /3 )„v 4 , x 2 = (1/2)x 4 , x 3 = ( 1 /6)x 4 , with ,v 4 free. Take x 4 = 6. Then x\ = 2, 
Xi = 3, andx 3 = 1. The balanced equation is 

2Na 3 P0 4 + 3Ba(N0 3 ) 2 -> Ba 3 (P0 4 ) 2 + 6NaN0 3 


7. The following vectors list the numbers of atoms of sodium (Na), hydrogen (H), carbon (C), and 
oxygen (O): 



T 


“ 0 “ 


3" 


“ 0 “ 


“ 0 " 


1 


8 


5 


2 


0 

NaHCOj : 

1 

, H 3 C 6 H 5 0 7 : 

6 

, Na 3 C 6 H 5 0 7 : 

6 

, H 2 0 : 

0 

, C0 2 : 

1 


3 


1 _ 


1 _ 


1 


2 


sodium 

hydrogen 

carbon 

oxygen 


The order of the various atoms is not important. The list here was selected by writing the elements in the 
order in which they first appear in the chemical equation, reading left to right: 

x i • NaHC0 3 .r 2 • H 3 CgH 507 — > x 3 ■ Na 3 CgH 507 + x 4 ■ H 2 0 + X 5 • C0 2 . 

The coefficients X\, ...,xs satisfy the vector equation 



T 


" 0 " 


"3" 


" 0 " 


" 0 " 


l 


8 


5 


2 


0 

x l 


+ x 2 


= x 3 


+ x 4 


+ x 5 



l 


6 

6 

0 


1 


3 


1 _ 


1 _ 


1 


2 


Move all the terms to the left side (changing the sign of each entry in the third, fourth, and fifth vectors) 
and reduce the augmented matrix: 


"1 

0 

-3 

0 

0 

0 " 


"1 

0 

0 

0 

-1 

0 " 

1 

8 

-5 

-2 

0 

0 


0 

1 

0 

0 

-1/3 

0 

1 

6 

-6 

0 

-1 

0 


0 

0 

1 

0 

-1/3 

0 

3 

7 

-7 

-1 

-2 

0 


0 

0 

0 

1 

-1 

0 


The general solution is X\ = x 5 , x 2 = ( 1/3 )v 5 , x 3 = (l/3)x 5 , x 4 = x 5 , and x 5 is free. Take x 5 = 3. Then jc 3 =x 4 = 
3, and x 2 = x 3 = 1 . The balanced equation is 

3NaHC0 3 +H 3 C 6 H 5 0 7 -> Na 3 C 6 H 5 0 7 + 3H 2 0 + 3C0 2 


8. The following vectors list the numbers of atoms of potassium (K), manganese (Mn), oxygen (O), 
sulfur (S), and hydrogen (H): 


KMn0 4 : 


"l" 


"0" 


“0" 


“0" 


'2" 


“0" 

1 


1 


0 


1 


0 


0 

4 

, MnS0 4 : 

4 

, H 2 0: 

1 

, MnO,: 

2 

, K 2 S0 4 : 

4 

, H 2 S0 4 : 

4 

0 


1 


0 


0 


1 


1 

_0_ 


_0_ 


_2_ 


_0_ 


_0_ 


_ 2 _ 


The coefficients in the chemical equation 


potassium 

manganese 

oxygen 

sulfur 

hydrogen 
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xrKMn 0 4 + X2-MnS0 4 + X3H2O — > x 4 -Mn02 + X5K2SO4 + X 6 H 2 S 0 4 
satisfy the vector equation 


"1" 


"0" 


"0" 


"0" 


"2" 


"0" 

1 


1 


0 


1 


0 


0 

4 

+ x 2 

4 

+ x 3 

1 

= x 4 

2 

+ x 5 

4 

+ x 6 

4 

0 


1 


0 


0 


1 


1 

0 


0 


2 


0 


0 


2 


Move the terms to the left side (changing the sign of each entry in the last three vectors) and reduce the 
augmented matrix: 


“1 

0 

0 

0 

-2 

0 

0 “ 


"© 0 

0 

0 

0 

- 1.0 

0 " 

1 

1 

0 

-1 

0 

0 

0 


0 

© 

0 

0 

0 

- 1.5 

0 

4 

4 

1 

-2 

-4 

-4 

0 

~ 

0 

0 

0 

© 

0 

-1.0 

0 

0 

1 

0 

0 

-1 

-1 

0 


0 

0 

© 

0 

0 

- 2.5 

0 

0 

0 

2 

0 

0 

-2 

0 


0 

0 

0 

0 

© 

-.5 

0 


The general solution is X\ = x ( „ x 2 = (1.5)x6, X 3 = x&, x 4 = (2.5 )x 6 , X 5 = .5x6, and X 6 is free. 

Take X 6 = 2. Then x\ = X 3 = 2, and X 2 = 3, X 4 = 5, and xs = 1 . The balanced equation is 
2KMn0 4 + 3MnS0 4 + 2H 2 0 — > 5Mn0 2 + K 2 S0 4 + 2H 2 S0 4 

9. [M] Set up vectors that list the atoms per molecule. Using the order lead (Pb), nitrogen (N), chromium 
(Cr), manganese (Mn), and oxygen (O), the vector equation to be solved is 

lead 

nitrogen 
chromium 
manganese 
oxygen 

The general solution is xi = (1/6)x6, X2 = (22/45)x6, X3 = (1/18)x6, x 4 = (1 1/45)x6, X5 = (44/45)x6, and 
X 6 is free. Take X 6 = 90. Thenxi = 15, x 2 = 44, X 3 = 5, x 4 = 22, and X 5 = 88 . The balanced equation is 
1 5PbN 6 + 44CrMn 2 Og — > 5Pb 3 0 4 + 22Cr 2 0 3 + 88Mn0 2 + 90NO 

10. [Ml Set up vectors that list the atoms per molecule. Using the order manganese (Mn), sulfur (S), arsenic 
(As), chromium (Cr), oxygen (O), and hydrogen (H), the vector equation to be solved is 

manganese 
sulfur 
arsenic 
chromium 
oxygen 
hydrogen 

In rational format, the general solution is Xi = (16/327)x7, x 2 = (13/327)x7, X 3 = (374/327)x7, 
x 4 = (16/327 )x 7, X 5 = (26/327 )x 7, X 6 = (130/327)x7, and X 7 is free. Take X 7 = 327 to make the other 
variables whole numbers. The balanced equation is 

16MnS + 13As 2 Cr 10 O 3 5 + 374H 2 S0 4 — > 16HMn0 4 + 26AsH 3 + 130CrS 3 Oi 2 + 327H 2 0 


1 


0 


“0“ 


1 


“0“ 


0 


“ 0 " 

1 


0 


1 


0 


0 


3 


0 

0 

+ x 2 

2 

+ x 3 

0 

= x 4 

0 

+ x 5 

1 

+ x 6 

0 

+ x 7 

0 

0 


10 

0 

0 


0 


1 


0 

0 


35 


4 


4 


0 


12 


1 

0 


0 


2 


1 


3 


0 


2 


1 


“0“ 


“3“ 


“0“ 


“0“ 


“ 0 " 

6 


0 


0 


0 


0 


1 

0 

+ x 2 

1 

= x 3 

0 

+ x 4 

2 

+ x 5 

0 

+ x 6 

0 

0 


2 


0 


0 


1 


0 

0 


8 


4 


3 


2 


1 
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Note that some students may use decimal calculation and simply "round off' the fractions that relate X\, 
..., X6 to xj. The equations they construct may balance most of the elements but miss an atom or two. Here 
is a solution submitted by two of my students: 

5MnS + 4As 2 Cr 10 O 35 + 1 15H 2 S0 4 -» 5HMn0 4 + 8AsH 3 + 40CrS 3 O 12 + 100H 2 O 

Everything balances except the hydrogen. The right side is short 8 hydrogen atoms. Perhaps the students 
thought that the 4H 2 (hydrogen gas) escaped! 


11. Write the equations for each node: 


Node 

Flow in 

Flow out 

A 




20 -< 

A 

X) + x 3 

= 20 


B 

x 2 

= x 3 + x 4 


C 

80 

= Xj + x 2 

80 

C 

Total flow: 

80 

= X4+20 



Rearrange the equations: 


+ 

*2 - 
+ X, 


X, - X A = 


X, = 


= 20 
0 

80 
60 



Reduce the augmented matrix: 


"1 

0 

1 

0 

20" 


<X) 0 

1 

0 20" 

0 

1 

-1 

-1 

0 


0 (D 

-1 

0 60 

1 

1 

0 

0 

80 


0 0 

0 

O 

so 

© 

_0 

0 

0 

1 

60 


1 

0 

0 

0 

0 1 
0 


For this type of problem, the best description of the general solution uses the style of 
Section 1.2 rather than parametric vector form: 

Xj = 20 — x 3 


x 2 = 60 + x 3 
x 3 is free 
x 4 = 60 


. Since x x cannot be negative, the largest value of x 3 is 20. 


12 . Write the equations for each intersection: 


Intersection 

Flow in 

Flow out 

A 

Xi 

= x 3 + x 4 + 40 

B 

200 

= x \ + x 2 

C 

x 2 +x 3 

= x 5 + 1 00 

D 

x 4 +x 5 

= 60 

Total flow: 

200 

200 


200 
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Rearrange the equations: 


Xj 



- 

x 3 - 


x 4 



= 

40 


Xj 

+ 

x 2 







= 

200 




*2 

+ 

x 3 



- 

*5 

= 

100 








x 4 

+ 

*5 

= 

60 


Reduce the augmented matrix: 








"1 0 

-1 

-1 

0 

40 


© 

0 

-1 

0 

1 

100 

1 1 

0 

0 

0 

200 


0 

G) 

1 

0 

-1 

100 

0 1 

1 

0 

-1 

100 


0 

0 

0 

© 

1 

60 

' O 
O 

0 

1 

1 

60 


0 

0 

0 

0 

0 

0 


The general solution (written in the style of Section 1 .2) is 


x, = 1 00 + x 3 - x 5 
x 2 = 1 00 - x 3 + x 5 
x 3 is free 
x 4 = 60 - x 5 
x 5 is free 


b. When x 4 = 0, x 5 must be 60, and 


x, = 40 + x 3 
x 2 = 1 60 - x 3 
x 3 is free 
x 4 =0 
x 5 = 60 


c. The minimum value ofxi is 40 cars/minute, because X3 cannot be negative. 


13 . Write the equations for each intersection: 


Intersection Flow in 
A 
B 


x 2 +30 


C 

D 
E 

Total flow: 
Rearrange the equations: 


x 3 +x 5 

x 6 + 1 00 


x 4 +40 

Xj +60 

230 


Flow out 

Xj + 80 

x 2 +x 4 
x 5 + 40 
x 6 +90 
x 3 + 20 
230 


x, - X 1 


X-, - 


Xj - x 3 

Reduce the augmented matrix: 


1 -1 
0 
0 


0 

1 -1 

0 0 


0 0 
1 -1 


0 0 
0 -1 


0 

1 

0 


0 
0 

1 -1 


0 -1 

0 0 


-50 

0 

60 

50 

-40 


30 


40 



X, - X fi = 


- X. = 


= -50 

= 0 
60 
50 
-40 


-1 0 

1 -1 

0 0 

0 0 

0 0 


0 

1 

1 

0 

0 


0 

-1 

0 


0 

0 

-1 


1 -1 

0 0 


-50 

0 

50 

60 

0 
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■0 

0 

-1 

0 0 0 

-40 


0 

0 

-1 

0 0 0 

10 

— 

0 

0 

0 

0 0 -1 

50 


0 

0 

0 

o 

© 

60 


0 

0 

0 

0 0 0 

0 





jCj = jc 3 — 40 

X 2 = X 3 + 1 0 


The general solution is • 

x 3 is free 
x 4 =x 6 + 50 






x 5 =x 6 + 60 
x 6 is free 



b. To find minimum flows, note that since x\ cannot be negative, xt, > 40. This implies that 
xi > 50. Also, since x (< cannot be negative, x 4 > 50 and x 5 > 60. The minimum flows are 
x 2 = 50, x 3 = 40, x 4 = 50, x 5 = 60 (when x t =0 and x 6 = 0). 


14 . Write the equations for each intersection. 


Intersection 

Flow in 

Flow out 

A 

x i 

= x 2 + 1 00 

B 

x 2 +50 

= X 3 

C 

X 3 

= x 4 +120 

D 

x 4 +150 

= *5 

E 

*5 

= Xg + 80 

F 

x 6 + 1 00 

= x i 


Rearrange the equations: 

T - * 2 

x 2 - x 3 

x 3 - x 4 
X 4 

~ X 1 

Reduce the augmented matrix: 


120 150 



= 100 
= -50 

= 120 
= -150 

*5 - *6 = 

+ x 6 - -100 


1 

-1 

0 

0 

0 

0 

100" 


"1 

-1 

0 

0 

0 

0 

100" 

0 

1 

-1 

0 

0 

0 

-50 


0 

1 

-1 

0 

0 

0 

-50 

0 

0 

1 

-1 

0 

0 

120 


0 

0 

1 

-1 

0 

0 

120 

0 

0 

0 

1 

-1 

0 

-150 


0 

0 

0 

1 

-1 

0 

-150 

0 

0 

0 

0 

1 

-1 

80 


0 

0 

0 

0 

1 

-1 

80 

-1 

0 

0 

0 

0 

1 

-100 


0 

0 

0 

0 

0 

0 

0 
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"1 

0 

0 

0 

0 

-1 

100" 


jCj =100 + x 6 

0 

1 

0 

0 

0 

-1 

0 


x 2 =x 6 

0 

0 

1 

0 

0 

-1 

50 

. The general solution is < 

x 3 =50 + x 6 

0 

0 

0 

1 

0 

-1 

-70 

x 4 = -70 + x 6 

0 

0 

0 

0 

1 

-1 

80 


x 5 =80 + x 6 

0 

0 

0 

0 

0 

0 

0 


x 6 is free 


Since X 4 cannot be negative, the minimum value of w, is 70. 

Note: The MATLAB box in the Study Guide discusses rational calculations, needed for balancing the 
chemical equations in Exercises 9 and 10. As usual, the appendices cover this material for Maple, 
Mathematica, and the TI and HP graphic calculators. 


1.7 SOLUTIONS 


Note: Key exercises are 9-20 and 23-30. Exercise 30 states a result that could be a theorem in the text. There 
is a danger, however, that students will memorize the result without understanding the proof, and then later 
mix up the words row and column. Exercises 37 and 38 anticipate the discussion in Section 1.9 of one-to-one 
transformations. Exercise 44 is fairly difficult for my students. 


1. Use an augmented matrix to study the solution set of X|U + x 2 v + x 3 w = 0 (*), where u, v, and w are the 

, there are no free variables. So the 



1 

0 
OS 

r- 

ID 

1 


"(5) 7 9 0" 

three given vectors. Since 

0 2 4 0 

~ 

0 (2) 4 0 


0-6-8 0 


0 0 © 0 


homogeneous equation (*) has only the trivial solution. The vectors are linearly independent. 

2. Use an augmented matrix to study the solution set of X|U + x 2 v + x 3 w = 0 (*), where u, v, and w are the 



"0 

0 

-3 

O' 


"© -8 

1 

0 " 

three given vectors. Since 

0 

5 

4 

0 

~ 

0 © 

4 

0 


2 

-8 

1 

0 


0 0 

© 

0 


, there are no free variables. So the 

homogeneous equation (*) has only the trivial solution. The vectors are linearly independent. 

3. Use the method of Example 3 (or the box following the example). By comparing entries of the vectors, 
one sees that the second vector is -3 times the first vector. Thus, the two vectors are linearly dependent. 


4. From the first entries in the vectors, it seems that the second vector of the pair 


"-1" 

'-2" 

4 ' 

’[-8 


may be 2 


times the first vector. But there is a sign problem with the second entries. So neither of the vectors is a 
multiple of the other. The vectors are linearly independent. 


5. Use the method of Example 2. Row reduce the augmented matrix for Ax = 0: 


" 0 

-8 

5 

0 " 


1 

-3 

2 

0 " 


"1 

-3 

2 

0 " 


"1 

-3 

2 

0 " 


-© 

-3 

2 

0 " 

3 

-7 

4 

0 


3 

-7 

4 

0 


0 

2 

-2 

0 


0 

2 

-2 

0 


0 

© 

-2 

0 

-1 

5 

-4 

0 


-1 

5 

-4 

0 


0 

2 

-2 

0 


0 

0 

0 

0 


0 

0 

9 

0 

1 

-3 

2 

0 


0 

-8 

5 

0 


0 

-8 

5 

0 


0 

0 

-3 

0 


0 

0 

0 

0 
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There are no free variables. The equation Ax = 0 has only the trivial solution and so the columns of A are 
linearly independent. 

6. Use the method of Example 2. Row reduce the augmented matrix for Ax = 0: 


"-4 

-3 

0 

0 " 


1 

0 

3 

0 " 


"1 

0 

3 

0 " 


"1 

0 

3 

0 " 


© 

0 

3 

0 " 

0 

-1 

4 

0 


0 

-1 

4 

0 


0 

-1 

4 

0 


0 

-1 

4 

0 


0 

0 

4 

0 

1 

0 

3 

0 


-4 

-3 

0 

0 


0 

-3 

12 

0 


0 

0 

0 

0 


0 

0 

© 

0 

5 

4 

6 

0 


5 

4 

6 

0 


0 

4 

-9 

0 


0 

0 

7 

0 


0 

0 

0 

0 


There are no free variables. The equation Ax = 0 has only the trivial solution and so the columns of A are 
linearly independent. 

7. Study the equation Ax = 0. Some people may start with the method of Example 2: 


1 

4 

-3 

0 

0 " 


"1 

4 

-3 

0 

0 " 


© 

4 -3 

0 

0 " 

-2 

-7 

5 

1 

0 

~ 

0 

1 

-1 

1 

0 

~ 

0 

© -1 

1 

0 

-4 

-5 

7 

5 

0 


0 

11 

-5 

5 

0 


0 

0 © 

-6 

0 


But this is a waste of time. There are only 3 rows, so there are at most three pivot positions. Hence, at 
least one of the four variables must be free. So the equation Ax = 0 has a nontrivial solution and the 
columns of A are linearly dependent. 

8. Same situation as with Exercise 7. The (unnecessary) row operations are 


1 

-3 

3 

-2 

0“ 


“1 

-3 

3 

-2 

0“ 


© 

-3 

3 

-2 0" 

-3 

7 

-1 

2 

0 

~ 

0 

-2 

8 

-4 

0 

~ 

0 

0 

8 

-4 0 

0 

1 

-4 

3 

0 


0 

1 

-4 

3 

0 


0 

0 

0 

© o_ 


Again, because there are at most three pivot positions yet there are four variables, the equation Ax = 0 
has a nontrivial solution and the columns of A are linearly dependent. 

9. a. The vector V3 is in Span{vi, V2} if and only if the equation jtiVi + xxvi = V3 has a solution. To find out, 
row reduce [vi V2 V3], considered as an augmented matrix: 


1 

-3 

5“ 


© 

-3 

5 

-3 

9 

-7 

~ 

0 

0 

© 

2 

-6 

h 


0 

0 

A-10 


At this point, the equation 0 = 8 shows that the original vector equation has no solution. So v 3 is in 
Span{vi, V2} for no value of h. 

b. For {vi, v 2 , v 3 } to be linearly independent, the equation x,V| + x 2 v 2 +x 3 v 3 = 0 must have only the 
trivial solution. Row reduce the augmented matrix [vi v 2 v 3 0] 


1 

-3 

5 

0" 


"1 

-3 

5 0" 


© 

-3 

5 

0" 

-3 

9 

-7 

0 

~ 

0 

0 

8 0 

~ 

0 

0 

® 

0 

2 

-6 

h 

0 


0 

0 

h - 10 0 


0 

0 

0 

0 


For every value of h, X 2 is a free variable, and so the homogeneous equation has a nontrivial solution. 
Thus {vi, v 2 , v 3 } is a linearly dependent set for all h. 
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10. a. The vector v 3 is in Span [v,, v 2 } if and only if the equation .v , v , + x 2 v 2 = v 3 has a solution. To find out, 
row reduce [vi v 2 v 3 ], considered as an augmented matrix: 


1 

-2 

2" 


(2) 

-2 

2 

-5 

10 

-9 

~ 

0 

0 

(D 

-3 

6 

h 


0 

0 

h + 6 


At this point, the equation 0 = 1 shows that the original vector equation has no solution. So v 3 is in 
Span{vi, v 2 } for no value of h. 

b. For {vi, v 2 , v 3 } to be linearly independent, the equation or i v i +x 2 v 2 + x 3 v 3 = 0 must have only the 
trivial solution. Row reduce the augmented matrix [vi v 2 v 3 0] 


1 

-2 

2 

0 " 


"1 

-2 

2 

0 " 


ID 

-2 

2 

0 " 

-5 

10 

-9 

0 

~ 

0 

0 

1 

0 

~ 

0 

0 

(D 

0 

-3 

6 

h 

0 


0 

0 

h + 6 

0 


0 

0 

0 

0 


For every value of h, x 2 is a free variable, and so the homogeneous equation has a nontrivial solution. 
Thus {vi, v 2 , v 3 } is a linearly dependent set for all h. 

11. To study the linear dependence of three vectors, say vi, v 2 , v 3 , row reduce the augmented matrix 
[vi v 2 v 3 0 ]: 


1 

3 

-1 

0“ 


“1 

3 

-1 

0“ 



3 

-1 

0 " 

-1 

-5 

5 

0 

~ 

0 

-2 

4 

0 

~ 

0 

© 4 

0 

4 

7 

h 

0 


0 

-5 

h + 4 

0 


0 

0 

h — 6 

0 


The equation jciVi + x 2 v 2 + x 3 v 3 = 0 has a nontrivial solution if and only if A — 6 = 0 (which corresponds to 
x 3 being a free variable). Thus, the vectors are linearly dependent if and only if h = 6. 

12. To study the linear dependence of three vectors, say vi, v 2 , v 3 , row reduce the augmented matrix 
[vi v 2 v 3 0 ]: 


“ 2 

-6 

8 

0“ 



-6 

8 

0 " 

-4 

7 

h 

0 

~ 

0 

© 

A + 16 

0 

1 

-3 

4 

0 


0 

0 

0 

0 


The equation jciVi + x 2 v 2 + x 3 v 3 = 0 has a free variable and hence a nontrivial solution no matter what the 
value of h. So the vectors are linearly dependent for all values of h. 

13. To study the linear dependence of three vectors, say vi, v 2 , v 3 , row reduce the augmented matrix 
[vi v 2 v 3 0 ]: 


1 

-2 

3 

0 " 


"© 

-2 

3 

0 " 

5 

-9 

h 

0 

~ 

0 

0 h - 15 

0 

-3 

6 

-9 

0 


0 

0 

0 

0 


The equation jciVi + x 2 v 2 + x 3 v 3 = 0 has a free variable and hence a nontrivial solution no matter what the 
value of h. So the vectors are linearly dependent for all values of h. 
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14. To study the linear dependence of three vectors, say Vi, v 2 , v 3 , row reduce the augmented matrix 
[Vi v 2 v 3 0]: 


1 

-5 

1 

0 " 


"1 

-5 

1 

0 " 


"© -5 

1 

0 " 

-1 

7 

1 

0 

~ 

0 

2 

2 

0 

~ 

0 (2) 

2 

0 

-3 

8 

h 

0 


0 

-7 

h + 3 

0 


0 0 

/; +10 

0 


The equation X|V| + x 2 v 2 + x 3 v 3 = 0 has a nontrivial solution if and only if/; + 10 = 0 (which corresponds 
to x 3 being a free variable). Thus, the vectors are linearly dependent if and only 
if/; =-10. 

15. The set is linearly dependent, by Theorem 8, because there are four vectors in the set but only two entries 
in each vector. 

16. The set is linearly dependent because the second vector is 3/2 times the first vector. 

17. The set is linearly dependent, by Theorem 9, because the list of vectors contains a zero vector. 

18. The set is linearly dependent, by Theorem 8, because there are four vectors in the set but only two entries 
in each vector. 


19. The set is linearly independent because neither vector is a multiple of the other vector. [Two of the 
entries in the first vector are - 4 times the corresponding entry in the second vector. But this multiple 
does not work for the third entries.] 


20. The set is linearly dependent, by Theorem 9, because the list of vectors contains a zero vector. 

21. a. False. A homogeneous system always has the trivial solution. See the box before Example 2. 

b. False. See the warning after Theorem 7. 

c. True. See Fig. 3, after Theorem 8. 

d. True. See the remark following Example 4. 


22. a. True. See Fig. 1. 


b. False. For instance, the set consisting of 

f 

-2 

and 

“ 2" 
-A 


3 


6 


is linearly dependent. See the warning after 


Theorem 8. 

c. True. See the remark following Example 4. 

d. False. See Example 3(a). 











"■ 

* 


"0 


"■ 

* 

* 

1 














■ 

*“ 

"0 

■" 

"0 

0 


0 

■ 


0 

0 

0 

■ 

* 

24. 







25. 


and 





0 

0 

’ 0 

o 1 

’ 0 

0 


0 

0 


0 

0 

0 

0 

■ 



- 1 


- 1 


- 1 
















0 

0 


0 

0 
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26. 


27. 

28. 
29. 


30. 


31. 

32. 

33. 

34. 

35. 

36. 


37. 

38. 


^ * * 

0 «* 
0 0 B 

0 0 0 


. The columns must linearly independent, by Theorem 7, because the first column is not 


zero, the second column is not a multiple of the first, and the third column is not a linear combination 
of the preceding two columns (because a 3 is not in Span{ai, a 2 }). 


All five columns of the 7x5 matrix A must be pivot columns. Otherwise, the equation Ax = 0 would have 
a free variable, in which case the columns of A would be linearly dependent. 

If the columns of a 5x7 matrix A span R 5 , then A has a pivot in each row, by Theorem 4. Since each pivot 
position is in a different column, A has five pivot columns. 


A: any 3x2 matrix with two nonzero columns such that neither column is a multiple of the other. In this 
case the columns are linearly independent and so the equation Ax = 0 has only the trivial solution. 

B: any 3x2 matrix with one column a multiple of the other. 


a. « 

b. The columns of A are linearly independent if and only if the equation Ax = 0 has only the trivial 
solution. This happens if and only if Ax = 0 has no free variables, which in turn happens if and only if 
every variable is a basic variable, that is, if and only if every column of A is a pivot column. 

Think of A = [ai a 2 a 3 ]. The text points out that a 3 = a! + a 2 . Rewrite this as a , + a 2 - a 3 = 0. As a 
matrix equation, Ax = 0 for x = (1, 1, -1). 

Think of A = [a! a 2 a 3 ]. The text points out that a, + 2a 2 = a 3 . Rewrite this as a, + 2a 2 - a 3 = 0. As a 
matrix equation, Ax = 0 for x = (1, 2, -1). 

True, by Theorem 7. (The Study Guide adds another justification.) 

True, by Theorem 9. 

False. The vector v 3 could be the zero vector. 

False. Counterexample: Take Vi, v 2 , and V 4 all to be multiples of one vector. Take v 3 to be not a multiple 
of that vector. For example, 



T 


" 2 " 


"f 


4" 

V 1 = 

1 

,V 2 = 

2 

,v 3 = 

0 

,v 4 = 

4 

1 


2 


0 


4 


1 


2 


0 


4 


True. A linear dependence relation among Vi, v 2 , v 3 may be extended to a linear dependence relation 
among Vi, v 2 , v 3 , V4 by placing a zero weight on V4. 

True. If the equation jtiVi + x 2 v 2 + x 3 v 3 = 0 had a nontrivial solution (with at least one of x u x 2 , x 3 
nonzero), then so would the equation jciVi + x 2 v 2 + x 3 v 3 + 0-v 4 = 0. But that cannot happen because 

{vi, v 2 , v 3 , V4} is linearly independent. So {vi, v 2 , v 3 } must be linearly independent. This problem can 
also be solved using Exercise 37, if you know that the statement there is true. 
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39. If for all b the equation Ax = b has at most one solution, then take b = 0, and conclude that the equation 
Ax = 0 has at most one solution. Then the trivial solution is the only solution, and so the columns of A are 
linearly independent. 


40. An m y n matrix with n pivot columns has a pivot in each column. So the equation Ax = b has no free 
variables. If there is a solution, it must be unique. 
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The pivot columns of A are 1, 2, and 5. Use them to form 


Other likely choices use columns 3 or 4 of A instead of 2: 



-3 

2 

4 

-7 

-2 

4 

-1 

10 

21 

r 


-7 

4 

10 


-9 

6 

5 


-7 

2 

11 

-7 

-4 

4 

0 

10 


Actually, any set of three columns of A that includes column 5 will work for B , but the concepts needed 
to prove that are not available now. (Column 5 is not in the two-dimensional subspace spanned by the 
first four columns.) 


42. [M] 
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The pivot columns of A are 1, 2, 4, and 6. Use them to form B = 
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Other likely choices might use column 3 of A instead of 2, and/or use column 5 instead of 4. 
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43. [M] Make v any one of the columns of A that is not in B and row reduce the augmented matrix [B v]. 
The calculations will show that the equation Bx = v is consistent, which means that v is a linear 
combination of the columns of B. Thus, each column of A that is not a column of B is in the set spanned 
by the columns of B. 

44. [M] Calculations made as for Exercise 43 will show that each column of A that is not a column of B is in 
the set spanned by the columns of B. Reason : The original matrix A has only four pivot columns. If one 
or more columns of A are removed, the resulting matrix will have at most four pivot columns. (Use 
exactly the same row operations on the new matrix that were used to reduce A to echelon form.) If v is a 
column of A that is not in B , then row reduction of the augmented matrix [B v] will display at most four 
pivot columns. Since B itself was constructed to have four pivot columns, adjoining v cannot produce a 
fifth pivot column. Thus the first four columns of [B v] are the pivot columns. This implies that the 
equation Bx = x has a solution. 

Note: At the end of Section 1.7, the Study Guide has another note to students about “Mastering Linear 
Algebra Concepts.” The note describes how to organize a review sheet that will help students form a mental 
image of linear independence. The note also lists typical misuses of terminology, in which an adjective is 
applied to an inappropriate noun. (This is a major problem for my students.) 1 require my students to prepare a 
review sheet as described in the Study Guide, and 1 try to make helpful comments on their sheets. 1 am 
convinced, through personal observation and student surveys, that the students who prepare many of these 
review sheets consistently perform better than other students. Hopefully, these students will remember 
important concepts for some time beyond the final exam. 


1.8 SOLUTIONS 

Notes: The key exercises are 17-20, 25 and 31. Exercise 20 is worth assigning even if you normally assign 
only odd exercises. Exercise 25 (and 27) can be used to make a few comments about computer graphics, even 
if you do not plan to cover Section 2.6. For Exercise 31, the Study Guide encourages students not to look at 
the proof before trying hard to construct it. Then the Guide explains how to create the proof. 

Exercises 19 and 20 provide a natural segue into Section 1.9. 1 arrange to discuss the homework on these 
exercises when I am ready to begin Section 1.9. The definition of the standard matrix in Section 1.9 follows 
naturally from the homework, and so I’ve covered the first page of Section 1.9 before students realize we are 
working on new material. 

The text does not provide much practice determining whether a transformation is linear, because the time 
needed to develop this skill would have to be taken away from some other topic. If you want your students to 
be able to do this, you may need to supplement Exercises 29, 30, 32 and 33. 

If you skip the concepts of one-to-one and “onto” in Section 1.9, you can use the result of Exercise 31 to 
show that the coordinate mapping from a vector space onto R" (in Section 4.4) preserves linear independence 
and dependence of sets of vectors. (See Example 6 in Section 4.4.) 
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7. a = 5; the domain of T is R\ because a 6><5 matrix has 5 columns and for Ax to be defined, x must be in 
R 5 . b = 6; the codomain of T is R 6 , because Ax is a linear combination of the columns of A, and each 
column of A is in R 6 . 


8. A must have 5 rows and 4 columns. For the domain of T to be R 4 , A must have four columns so that Ax is 
defined for x in R 4 . For the codomain of T to be R 5 , the columns of A must have five entries (in which 
case A must have five rows), because Ax is a linear combination of the columns of A. 
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9. Solve Ax = 0 . 
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10 . Solve Ax = 0. 
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11. Is the system represented by [A b] consistent? Yes, as the following calculation shows. 
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The system is consistent, so b is in the range of the transformation x I— > Ax . 
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12. Is the system represented by [A b] consistent? 
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The system is inconsistent, so b is not in the range of the transformation x I— > Ax . 


13. 


14. 



A reflection through the origin. A contraction by the factor .5. 

The transformation in Exercise 1 3 may also be described as a rotation of n radians about the origin or 
a rotation of — 7t radians about the origin. 


15. 


16. 



A projection onto the x 2 -axis 


A reflection through the line x 2 = x\. 


17. T(3u) = 3T(u) = 3 



> T(2v) = 2T(\) = 




J(3u + 2v) = 3T(u) = 2T(v) = 
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18. Draw a line through w parallel to v, and draw a line through w parallel to u. See the left part of the figure 
below. From this, estimate that w = u + 2v. Since T is linear, T( w) = T(u) + 2T(v). Locate 7'(u) and 2 T(\) 
as in the right part of the figure and form the associated parallelogram to locate T{ w). 




19. All we know are the images of ei and e 2 and the fact that T is linear. The key idea is to write 

= 5 ej - 3 e 2 . Then, from the linearity of T, write 
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To find the image of 


, observe that x = 


T(x) = T(x id + x 2 e 2 ) = xiT(ei) + x 2 T(e 2 ) = x x 


= x, 
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+ x 2 
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= x ] e ] + x 2 e 2 . Then 


2x l - x 2 


5x { + 6 x 2 


20. Use the basic definition of /lx to construct A. Write 


T(x) = x 1 x 1 +x 2 y 2 = [v t v 2 ] 


-2 7 

5 -3 


x, A = 


-2 7 

5 -3 


21. a. True. Functions from R" to R" ! are defined before Fig. 2. A linear transformation is a function with 

certain properties. 

b. False. The domain is R 5 . See the paragraph before Example 1. 

c. False. The range is the set of all linear combinations of the columns of A. See the paragraph before 
Example 1. 

d. False. See the paragraph after the definition of a linear transformation. 

e. True. See the paragraph following the box that contains equation (4). 

22. a. True. See the paragraph following the definition of a linear transformation. 

b. False. If A is an m x« matrix, the codomain is R m . See the paragraph before Example 1. 

c. False. The question is an existence question. See the remark about Example 1(d), following the 
solution of Example 1 . 

d. True. See the discussion following the definition of a linear transformation. 

e. True. See the paragraph following equation (5). 
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24. Given any x in R", there are constants c\, ...,c p such that x = ciVi + ••• c p v p , because Vi, ...,\ p span R". 
Then, from property (5) of a linear transformation, 

T(x) = ciTtvi) + -• + c p T(y p ) = c^O + •• + c p 0 = 0 

25. Any point x on the line through p in the direction of v satisfies the parametric equation 

x = p + tv for some value of t. By linearity, the image 7'(x) satisfies the parametric equation 

m = T( P + ^ = T(p) + tm (*) 

If T(v) = 0, then T(x) = Tip) for all values of t, and the image of the original line is just a single point. 
Otherwise, (*) is the parametric equation of a line through T(p) in the direction of 7’(v). 

26. Any point x on the plane P satisfies the parametric equation x = su + tv for some values of s and t. 

By linearity, the image T(x) satisfies the parametric equation 

T(x) = sT(u) + t7’(v) (.v, t in R) (*) 

The set of images is just Span { 7’( u ) , T(v)} . If T(u) and T(v) are linearly independent, Span { 7’(u), T(v)} is 
a plane through T(u), T(v), and 0. If 7’( u ) and T(v) are linearly dependent and not both zero, then 
Span { T(u), T(v)} is a line through 0. If T(u) = T(v) = 0, then Span { T(u), T(v)} is {0}. 

27. a. From Fig. 7 in the exercises for Section 1.5, the line through T(p) and T(q) is in the direction of q - p, 

and so the equation of the line is x = p + t(q - p) = p + tq - tp = (1 - t)p + tq. 

b. Consider x = (1 - t)p + tq for t such that 0 < t < 1. Then, by linearity of T, 

m = m - t) P + tq) - (i - ?)7'(p ) + tm o < # < 1 (*) 

If T(p) and 7fq) are distinct, then (*) is the equation for the line segment between 7’(p) and T(q), as 
shown in part (a) Otherwise, the set of images is just the single point T(p), because 

(1 - t)7Tp) + tr(q) =(1 - i)Ti p) + tr(p) = Tip) 

28. Consider a point x in the parallelogram determined by u and v, say x = au + b\ for 0 < a < 1, 0 < b < 1 . 
By linearity of T, the image of x is 

T(x) = r(nu + by) = aT(u) + 7iT(v), for 0 < a < 1, 0 < b < 1 (*) 

This image point lies in the parallelogram determined by T(u) and T(v). 

Special “degenerate” cases arise when T(u) and Tiy) are linearly dependent. If one of the images is not 
zero, then the “parallelogram” is actually the line segment from 0 to T(u) + T(v). If both 7'( u ) and T(y ) 
are zero, then the parallelogram is just {0}. Another possibility is that even u and v are linearly 
dependent, in which case the original parallelogram is degenerate (either a line segment or the zero 
vector). In this case, the set of images must be degenerate, too. 

29. a. When b = 0,/ (x) = mx. In this case, for all x,y in R and all scalars c and d, 

f icx + dy) = micx + dy) = mcx + mdy = c(mx) + d(my) = cf (x) + df (y) 

This shows that /is linear. 
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b. When / (x) = mx + b, with b nonzcro,/(0) = m(0) = b = b A 0. This shows that /is not linear, because 
every linear transformation maps the zero vector in its domain into the zero vector in the codomain. 
(In this case, both zero vectors are just the number 0.) Another argument, for instance, would be to 
calculate / (2x) = m(2x) + b and 2/ (x) = 2 mx + 2b. If b is nonzero, then / (2x) is not equal to 2 If (x) and 
so /is not a linear transformation. 

c. In calculus, /is called a “linear function” because the graph of /is a line. 

30. Let 7(x) = Ax + b for x in R". If b is not zero, 7(0) = AO + b = b A 0. Actually, 7 fails both properties 
of a linear transformation. For instance, T( 2x) = A( 2x) + b 2 Ax + b, which is not the same as 27(x) = 

2 (Ax + b) = 2 Ax + 2b. Also, 

T(x + y) = A(x + y) + b = Ax + Ay + b 
which is not the same as 

T(x) + T( y) = Ax + b + Ay + b 

31. (The Study Guide has a more detailed discussion of the proof.) Suppose that {vi, v 2 , v 3 } is linearly 
dependent. Then there exist scalars c\, c 2 , c 3 , not all zero, such that 

CiVi + c 2 v 2 + c 3 v 3 = 0 

Then T{c\\\ + c 2 v 2 + c 3 v 3 ) = 7(0) = 0. Since 7 is linear, 
ci7(vi) + c 2 7(v 2 ) + c 3 7(v 3 ) = 0 

Since not all the weights are zero, (7(vi), 7(v 2 ), 7(v 3 )} is a linearly dependent set. 

32. Take any vector (xi, x 2 ) with x 2 A 0, and use a negative scalar. For instance, 7(0, 1) = (-2, 3), but 
7(-T(0, 1)) = 7(0, -1) = (2, 3) A (-1)‘7(0, 1). 

33. One possibility is to show that 7 does not map the zero vector into the zero vector, something that every 
linear transformation does do. 7(0, 0) = (0, 4, 0). 

34. Suppose that (u, v} is a linearly independent set in R and yet 7(u) and 7(v) are linearly dependent. Then 
there exist weights c\, c 2 , not both zero, such that 

ci7(u) + c 2 7(v) = 0 

Because 7 is linear, 7(ciU + c 2 v) = 0. That is, the vector x = c 3 u + c 2 v satisfies 7(x) = 0. Furthermore, 
x cannot be the zero vector, since that would mean that a nontrivial linear combination of u and v is zero, 
which is impossible because u and v are linearly independent. Thus, the equation 7(x) = 0 has a 
nontrivial solution. 

35. Take u and v in R 3 and let c and d be scalars. Then 

cu + dx = (cu i + dv i, cih + dv 2 , cu 3 + dv 3 ). The transformation 7 is linear because 
7(cu + dx) = (cu i + dv i, cu 2 + dv 2 , - ( cu 3 + dv 3 )) = ( cu\ + dv i, cu 2 + dv 2 , cu 3 dv 3 ) 

= (cu\, cu 2 , cu 3 ) + (dv i, dv 2 , dv 3 ) = c(u\, u 2 , « 3 ) + d(v i, v 2 , v 3 ) 

= c7(u) + dT(x) 

36. Take u and v in R 3 and let c and d be scalars. Then 

cu + dx = (cii\ + dv i, cu 2 + dv 2 , cu 3 + dv 3 ). The transformation 7 is linear because 
7(cu + dx) = (cu\ + dv i, 0, c« 3 + dv 3 ) = (cu h 0, cw 3 ) + (dv u 0, dv 3 ) 

= c(u\, 0, « 3 ) + d(v i, 0, v 3 ) 

= c7(u) + dT(x) 
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37. [M] 
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39. [M] 
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yes, b is in the range of the transformation, 


because the augmented matrix shows a consistent system. In fact, 
x 1 = 4 + (7 / 2)x 4 
x 2 = 7 + (9/ 2)x 4 


the general solution is 


x 3 = 1 
x 4 is free 


; when x 4 = 0 a solution is x = 


40. [M] 
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, yes, b is in the range of the 


transformation, because the augmented matrix shows a consistent system. In fact, 


the general solution is 


x l = -5 / 4 - (3 / 4)x 4 
x 2 =— 11/4 — (5/4 )jc 4 
x 3 = 13/4 + (7/4)x 4 


; when x 4 = 1 a solution is x = 


x 4 is free 
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Notes: At the end of Section 1.8, the Study Guide provides a list of equations, figures, examples, 
and connections with concepts that will strengthen a student’s understanding of linear transformations. 
1 encourage my students to continue the construction of review sheets similar to those for “span” and “linear 
independence,” but 1 refrain from collecting these sheets. At some point the students have to assume the 
responsibility for mastering this material. 

If your students are using MATLAB or another matrix program, you might insert the definition of matrix 
multiplication after this section, and then assign a project that uses random matrices to explore properties of 
matrix multiplication. See Exercises 34-36 in Section 2.1. Meanwhile, in class you can continue with your 
plans for finishing Chapter 1. When you get to Section 2.1, you won’t have much to do. The Study Guide's 
MATLAB note for Section 2.1 contains the matrix notation students will need for a project on matrix 
multiplication. The appendices in the Study Guide have the corresponding material for Mathematica, Maple, 
and the T-83+/86/89 and HP-48G graphic calculators. 
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1.9 SOLUTIONS 


Notes: This section is optional if you plan to treat linear transformations only lightly, but many instructors 
will want to cover at least Theorem 10 and a few geometric examples. Exercises 15 and 16 illustrate a fast 
way to solve Exercises 17-22 without explicitly computing the images of the standard basis. 

The purpose of introducing one-to-one and onto is to prepare for the term isomorphism (in Section 4.4) 
and to acquaint math majors with these terms. Mastery of these concepts would require a substantial 
digression, and some instructors prefer to omit these topics (and Exercises 25-40). In this case, you can use 
the result of Exercise 31 in Section 1.8 to show that the coordinate mapping from a vector space onto R" (in 
Section 4.4) preserves linear independence and dependence of sets of vectors. (See Example 6 in Section 4.4.) 
The notions of one-to-one and onto appear in the Invertible Matrix Theorem (Section 2.3), but can be omitted 
there if desired 

Exercises 25-28 and 31-36 offer fairly easy writing practice. Exercises 31, 32, and 35 provide important 
links to earlier material. 


l.A = [TTeO 


r(e 2 )] = 


3 

1 

3 

1 


-5 

2 

0 

0 


2. A = [T( ei ) T(e 2 ) r(e 3 )] 


1 4 -5 

3-7 4 


3. T(e0 = -e 2 , T(e 2 ) = e u A= [-e, e, ] = 


1/V2’ 

T( 0. \ — 

~l/V 2 ~ 

A — 

1/V2 

1/V2" 

-1/V2 

, 1 (e 2 j - 

\/s[ 2 _ 

? A ~ 

1/ s/2 

1/V2 


5. T(ei) = e t - 2e 2 = 



T(e 2 ) = e 2 ,A = 



0 

1 



“3“ 


"1 3" 

6. T(ei) = ei, T(e 2 ) = e 2 + 3e, = 

1 

,A = 

0 1 


7. Follow what happens to ei and e 2 . Since ei is on the unit 
circle in the plane, it rotates through — 3 tt/ 4 radians into a 
point on the unit circle that lies in the third quadrant and 
on the line x 2 = x l (that is, y = x in more familiar notation). 
The point (-1,-1) is on the ine x 2 =x l , but its distance 
from the origin is s/2. So the rotational image of ei is 
(- 1 /V 2 ,— 1 /-\/ 2 ) . Then this image reflects in the horizontal 
axis to (-1 /s/2,1 /s/2) . 

Similarly, e 2 rotates into a point on the unit circle that lies in 
the second quadrant and on the line x 2 = x, , namely, 
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(-I/V2,— 1/a/2) . Then this image reflects in the horizontal 
axis to (-1/V2,1 A/2) . 

When the two calculations described above are written in vertical vector notation, the transformation’s 
standard matrix [ 7’( e 1 ) 7'(e2 )] is easily seen: 


"-1/V2" 


-1/V2’ 


I/V2" 


"l/>/2" 

A — 

"-1/V2 

1/V2" 


— > 

1/V2_ 

, e 2 — > 

-1/y/ 2 _ 

> 

_1/V2_ 

9 A ~ 

1/V2 

1/V2_ 


8. e 1 ^e 1 ^e 2 and e 2 — >-e 2 — >-e l5 so A = [e 2 -ej 


0 -1 

1 0 


9. The horizontal shear maps ei into ei, and then the reflection in the line x 2 = -x\ maps ei into -e 2 . 

(See Table 1.) The horizontal shear maps e 2 into e 2 into e 2 - 2t\. To find the image of e 2 - 2ei when it is 
reflected in the line x 2 = -X\, use the fact that such a reflection is a linear transformation. So, the image of 
e 2 - 2ei is the same linear combination of the images of e 2 and ei, namely, -ei - 2(-e 2 ) = - ei + 2e 2 . 

To summarize, 


Cj — > Cj — > — ©2 


and e 2 — >e 2 -2e, — >-ej +2e 2 , so 



-1 

2 


To find the image of e 2 - 2e 1 when it is reflected through the vertical axis use the fact that such a 
reflection is a linear transformation. So, the image of e 2 - 2ei is the same linear combination of the 
images of e 2 and ei, namely, e 2 + 2ei. 


10. e,->-e,-^-e 2 and e 2 — ->-e,, 


so A - 


0 

-1 


-1 

0 


11 . The transformation T described maps e, — > e, — > — e, and maps e 2 — >-e 2 — >-e 2 . A rotation through 
n radians also maps ei into — ei and maps e 2 into -e 2 . Since a linear transformation is completely 
determined by what it does to the columns of the identity matrix, the rotation transformation has the 
same effect as T on every vector in R“. 

12 . The transformation T in Exercise 8 maps ej — > e : — > e 2 and maps e 2 — » — e 2 — > — e, . A rotation about the 

origin through K l 2 radians also maps ei into e 2 and maps e 2 into -ei. Since a linear transformation is 
completely determined by what it does to the columns of the identity matrix, the rotation transformation 
has the same effect as T on every vector in R 2 . 

13 . Since (2, 1) = 2ei + e 2 , the image of (2, 1) under T is 2 Tfe 1 ) + T(e 2 ), by linearity of T. On the figure in the 
exercise, locate 2T(ei) and use it with T(e 2 ) to form the parallelogram shown below. 



1 
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14 . Since T(x) = Ax = [ai a 2 ]x =jtiai + x 2 a 2 : 
forming the parallelogram shown below. 


: -ai + 3a 2 , when x = (-1, 3), the image of x is located by 



3x { - 2x 3 
4x, 


x, - x 2 + x 3 


16 . By inspection, 


1 

-1" 



1 

1 

X 

to 

1 

2 

1 

= 

— 2jc, + x 2 



x 2 



1 

0 



Xi 


17 . To express T(x) as Ax , write T(x) and x as column vectors, and then fill in the entries in A by inspection, 
as done in Exercises 15 and 16. Note that since T(x) and x have four entries, A must be a 4x4 matrix. 

"0 0 0 O' 

110 0 
0 110 
0 0 11 


m - 


0 


Xj +x 2 


x 2 +x 3 


x 3 +x 4 



A 


18 . As in Exercise 17, write T(x) and x as column vectors. Since x has 2 entries, A has 2 columns. Since T(x) 
has 4 entries, A has 4 rows. 


2x 2 - 3xj 




'-3 

2" 

* 

1 

O 



Xi 


1 

-4 


= 

A 


= 



0 



_ X 2. 


0 

0 

x 2 




0 

1 


19 . Since T(x) has 2 entries, A has 2 rows. Since x has 3 entries, A has 3 columns. 





Xj 





Xj 

Xj - 5x 2 + 4x 3 





"1 

-5 

4 


— 

A 

x 2 

= 




x 2 

A 

O 

1 

02 





0 

1 

-6 





_ X 3 . 





. X 3 . 


20 . Since T(x) has 1 entry, A has 1 row. Since x has 4 entries, A has 4 columns. 


= [2 0 3 -4] 


[2x, + 3x 3 - 4x 4 ] = [ A j 
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21. T(\) 

1 
4 


*1 + x 2 
4jcj + 5x 2 
3 


4 

1 3 
1 -4 


1 1 
4 5 
(D 0 7' 

0 © -4 


. To solve T(x) 


row reduce the augmented matrix: 


x = 


7 

-4 


22. T(x) 


matrix: 


Xj - 2 x 2 





1 

-2 





X, 




X, 

-Xj + 3x 2 

— 

A 

1 

x 2 

— 

-1 

3 

1 

x 2 

3x, - 2x 2 





3 

-2 



. To solve T(x) : 


, row reduce the augmented 


1 

-2 

-f 


“1 

-2 

-\ 


“1 

-2 

-1 


0 

0 

5~ 



-1 

3 

4 

~ 

0 

1 

3 

~ 

0 

1 

3 

~ 

0 

® 

3 

, X = 

5 

_3_ 

3 

-2 

9 


0 

4 

12 


0 

0 

0 


0 

0 

0 




23. a. True. See Theorem 10. 

b. True. See Example 3. 

c. False. See the paragraph before Table 1. 

d. False. See the definition of onto. Any function from R" to R m maps each vector onto another vector. 

e. False. See Example 5. 


24. a. False. See the paragraph preceding Example 2. 

b. True. See Theorem 10. 

c. True. See Table 1. 

d. False. See the definition of one-to-one. Any function from R" to R m maps a vector onto a single 
(unique) vector. 

e. True. See the solution of Example 5. 


25. 


Three row interchanges on the standard matrix A of the transformation T in Exercise 1 7 produce 


'0 1 0 0 
0 0 10 
0 0 0 1 
0 0 0 0 


. This matrix shows that A has only three pivot positions, so the equation Ax 


0 has a 


nontrivial solution. By Theorem 11, the transformation T is not one-to-one. Also, since A does not have a 
pivot in each row, the columns of A do not span R 4 . By Theorem 12, T does not map R 4 onto R 4 . 


26. The standard matrix A of the transformation T in Exercise 2 is 2x3. Its columns are linearly dependent 
because A has more columns than rows. So T is not one-to-one, by Theorem 12. Also, A is row 

r® « -s' 


equivalent to 


0 @) 19 


, which shows that the rows of A span R . By Theorem 12, T maps R 


onto R . 

27. The standard matrix A of the transformation T in Exercise 19 is 


© -5 4 

0 © -6 


. The columns of A are 


linearly dependent because A has more columns than rows. So T is not one-to-one, by Theorem 12. Also, 
A has a pivot in each row, so the rows of A span R 2 . By Theorem 12, T maps R 3 onto R 2 . 
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28. 


The standard matrix A of the transformation T in Exercise 14 has linearly independent columns, because 
the figure in that exercise shows that &\ and a 2 are not multiples. So T is one-to-one, by Theorem 12. 
Also, A must have a pivot in each column because the equation Ax = 0 has no free variables. Thus, the 


echelon form of A is 


0 



Since A has a pivot in each row, the columns of A span R 2 . So T maps R 2 


onto R 2 . An alternate argument for the second part is to observe directly from the figure in Exercise 14 
that ai and a 2 span R 2 . This is more or less evident, based on experience with grids such as those in 
Figure 8 and Exercise 7 of Section 1.3. 


29. By Theorem 12, the columns of the standard matrix A must be linearly independent and hence the 

■ * *' 


equation Ax = 0 has no free variables. So each column of A must be a pivot column: A ■ 
Note that T cannot be onto because of the shape of A. 


OB* 
0 0 B 

0 0 0 


30. By Theorem 12, the columns of the standard matrix A must span R 3 . By Theorem 4, the matrix must 


have a pivot in each row. There are four possibilities for the echelon form: 


~B 

* 

* 

*“ 


"b 

* 

* 

* 


~B 

* 

* 

* 


"0 

B 

* 

* 

0 

B 

* 

* 

9 

0 

B 

* 

* 

9 

0 

0 

B 

* 

9 

0 

0 

B 

* 

0 

0 

■ 

* 


0 

0 

0 

■ 


0 

0 

0 

■ 


0 

0 

0 

■ 


Note that T cannot be one-to-one because of the shape of A. 


3E “T is one-to-one if and only if A has n pivot columns.” By Theorem 12(b), T is one-to-one if and only if 
the columns of A are linearly independent. And from the statement in Exercise 30 in Section 1.7, the 
columns of A are linearly independent if and only if A has n pivot columns. 

32. The transformation T maps R" onto R'” if and only if the columns of A span R m , by Theorem 12. This 
happens if and only if A has a pivot position in each row, by Theorem 4 in Section 1 .4. Since A has 

m rows, this happens if and only if A has m pivot columns. Thus, “T maps R" onto R"' if and only A has 
m pivot columns.” 

33. Define T : R” — > R"' by T(x) = Bx for some m x n matrix B, and let A be the standard matrix for T. 

By definition, A = |T(ei) • • • T(e„)], where e, is the /th column of However, by matrix-vector 
multiplication, 7'(e / ) = Bej = b,, the yth column of B. So A = [bi • • • b„] = B. 

34. The transformation T maps R" onto R'” if and only if for each y in R m there exists an x in R" such that 

y = T{x). 

35. If T : R" — > R'" maps R' ! onto M” , then its standard matrix A has a pivot in each row, by Theorem 12 

and by Theorem 4 in Section 1.4. So A must have at least as many columns as rows. That is, m < n. When 

T is one-to-one, A must have a pivot in each column, by Theorem 12, so m > n. 

36. Take u and v in R p and let c and d be scalars. Then 

r(S(cu + dx)) = T(c-S( u) + d-S(x)) because S is linear 

= cT(S(u)) + d-T(S(\)) because T is linear 

This calculation shows that the mapping x — > T(S(x)) is linear. See equation (4) in Section 1.8. 
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'-5 

10 

-5 

4' 


"1 

0 

0 

44/35' 


'© 0 

0 

1.2571" 

8 

3 

-4 

7 


0 

1 

0 

79/35 


0 CD 

0 

2.2571 

4 

-9 

5 

-3 


0 

0 

1 

86/35 


0 

0 

CD 

2.4571 

-3 

-2 

5 

4 


0 

0 

0 

0 


0 

0 

0 

0 


There is no pivot in the 


fourth column of the standard matrix A, so the equation Ax = 0 has a nontrivial solution. By Theorem 11, 
the transformation T is not one-to-one. (For a shorter argument, use the result of Exercise 31.) 


38. [M] 


" 7 

5 

4 

-9" 


"0 

0 

7 

0" 

10 

6 

16 

-4 


0 

® 

-9 

0 

12 

8 

12 

7 


0 

0 

0 

CD 

-8 

-6 

-2 

5_ 


0 

0 

0 

0 


. No. There is no pivot in the third column of the 


standard matrix A, so the equation Ax = 0 has a nontrivial solution. By Theorem 1 1 , the transformation T 
is not one-to-one. (For a shorter argument, use the result of Exercise 31.) 


39. [M] 


" 4 

-7 

3 

7 

5" 


"0 

0 

0 

5 

0" 

6 

-8 

5 

12 

-8 


0 

0 

0 

1 

0 

-7 

10 

-8 

-9 

14 

— 

0 

0 

0 

-2 

0 

3 

-5 

4 

2 

-6 


0 

0 

0 

0 

0 

-5 

6 

-6 

-7 

3 


0 

0 

0 

0 

0 


. There is not a pivot in every row, so 


the columns of the standard matrix do not span R 5 . By Theorem 12, the transformation T does not map 
R 5 onto R 5 . 


40. [M] 


" 9 

13 

5 

6 

-f 


"0 

0 

0 

0 

5' 

14 

15 

-7 

-6 

4 


0 

© 

0 

0 

-4 

-8 

-9 

12 

-5 

-9 

— 

0 

0 

0 

0 

0 

-5 

-6 

-8 

9 

8 


0 

0 

0 

© 

1 

13 

14 

15 

2 

11 


0 

0 

0 

0 

0 


. There is not a pivot in every row, so 


the columns of the standard matrix do not span R 5 . By Theorem 12, the transformation T does not map 
R 5 onto R 5 . 


1.10 SOLUTIONS 


E a. If X\ is the number of servings of Cheerios and X 2 is the number of servings of 100% Natural Cereal, 
then x\ and x 2 should satisfy 



nutrients 


nutrients 


quantities 


per serving 

+ x 2 

per serving of 

= 

of nutrients 


of Cheerios 


100% Natural 


required 


That is, 


"no" 


"130" 


"295" 

4 

+ x 2 

3 


9 

20 


18 


48 

2 


5_ 


8_ 
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b. 


The equivalent matrix equation is 


"110 130" 



"295" 

4 3 



9 

20 18 

_* 2 _ 


48 

2 5 _ 



8 


. To solve this, row reduce the augmented 


matrix for this equation. 


“110 

130 

295“ 


2 

5 

8“ 


1 

2.5 

4" 

4 

3 

9 


4 

3 

9 


4 

3 

9 

20 

18 

48 


20 

18 

48 


10 

9 

24 

2 

5 

8_ 


no 

130 

295_ 


110 

130 

295 


“1 

2.5 

4" 


“1 

2.5 

4" 


“1 

0 

1.5" 

0 

-7 

-7 


0 

1 

1 


0 

1 

1 

0 

-16 

-16 


0 

0 

0 


0 

0 

0 

0 

-145 

— 145 


0 

0 

0 


0 

0 

0 


The desired nutrients are provided by 1.5 servings of Cheerios together with 1 serving of 100% 
Natural Cereal. 


2. Set up nutrient vectors for one serving of Kellogg’s Cracklin’ Oat Bran (COB) and Kellogg's Crispix 
(Crp): 


Nutrients: 

COB 

Crp 

calories 

“110“ 


"no" 

protein 

3 


2 

carbohydrate 

21 


25 

fat 

3_ 


.4 


a. Let B = [COB Crp] = 


no 

no" 

3 

2 

21 

25 

3 

.4 


u = 


Then B u lists the amounts of calories, protein, carbohydrate, and fat in a mixture of three servings of 
Cracklin' Oat Bran and two servings of Crispix. 

b. Let u\ and u 2 be the number of servings of Cracklin’ Oat Bran and Crispix, respectively. Can these 


numbers satisfy the equation B 



110 

2.25 

24 

1 


? To find out, row reduce the augmented matrix 


“no 

no 

no" 


1 

1 

1“ 


“1 

1 

1“ 


“1 

1 

f 

3 

2 

2.25 


3 

2 

2.25 


0 

-1 

-.75 


0 

-1 

-.75 

21 

25 

24 


21 

25 

24 


0 

4 

3 


0 

0 

0 

3 

.4 

1 


_ 3 

.4 

1 


0 

-2.6 

-2 


0 

0 

-.05 
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The last row identifies an inconsistent system, because 0 = -.05 is impossible. So, technically, there is 
no mixture of the two cereals that will supply exactly the desired list of nutrients. However, one could 
tentatively ignore the final equation and see what the other equations prescribe. They reduce 
to U\ = .25 and u 2 = -75. What does the corresponding mixture provide? 



"110" 


"110" 


' 110" 

.25 -COB + .75 -Crp = .25 

3 

+ .75 

2 

= 

2.25 

21 


25 


24 


3 


.4 


1.05 


The error of 5% for fat might be acceptable for practical purposes. Actually, the data in COB and Crp 
are certainly not precise and may have some errors even greater than 5%. 


3 . Here are the data, assembled from Table 1 and Exercise 3: 



Mg of Nutrients/Unit 

Nutrients 

Nutrient 

milk 

soy 

flour 

whey 

soy 

prot. 

Required 

(milligrams) 

protein 

36 

51 

13 

80 

33 

carboh. 

52 

34 

74 

0 

45 

fat 

0 

7 

1.1 

3.4 

3 

calcium 

1.26 

.19 

.8 

.18 

.8 


a. Let x u x 2 , x 3 , x 4 represent the number of units of nonfat milk, soy flour, whey, and isolated soy 
protein, respectively. These amounts must satisfy the following matrix equation 


36 

51 

13 

80 

x i 


33 

52 

34 

74 

0 

x 2 


45 

0 

7 

1.1 

3.4 

x 3 


3 

.1.26 

.19 

.8 

.18. 

_x 4 _ 


_ .8 _ 


36 

51 

13 

80 

33 


1 

0 

0 

0 

.64 

52 

34 

74 

0 

45 


0 

1 

0 

0 

.54 

0 

7 

1.1 

3.4 

3 


0 

0 

1 

0 

-.09 

_1.26 

.19 

.8 

.18 

■ 8_ 


_0 

0 

0 

1 

-.21. 


The “solution” is Xj = .64, x 2 = .54, x 3 = -.09, x 4 = -.21. This solution is not feasible, because the 
mixture cannot include negative amounts of whey and isolated soy protein. Although the coefficients 
of these two ingredients are fairly small, they cannot be ignored. The mixture of .64 units of nonfat 
milk and .54 units of soy flour provide 50.6 g of protein, 51.6 g of carbohydrate, 3.8 g of fat, and .9 g 
of calcium. Some of these nutrients are nowhere close to the desired amounts. 


4 . Let xu x 2 , and x 3 be the number of units of foods 1, 2, and 3, respectively, needed for a meal. The values 
of xu x 2 , and x 3 should satisfy 


nutrients 


nutrients 


nutrients 


milligrams 
of nutrients 

(in mg) 

+ x 2 

(in mg) 

+ x 3 

(in mg) 



per unit 
offood 1 


per unit 
offood 2 

per unit 
offood 3 


required 
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From the given data, 



"l0" 


"20" 


~20“ 


"ioo" 

*1 

50 

+ x 2 

40 

+ x 3 

10 

= 

300 


30 


it) 


40 


200 


To solve, row reduce the corresponding augmented matrix: 


"10 

20 

20 

100' 


"10 

20 

20 

100" 


"1 

2 

2 

10 " 

50 

40 

10 

300 

~ 

0 

-60 

-90 

-200 

~ 

0 

1 

3/2 

10/3 

30 

10 

40 

200 


0 

-50 

-20 

-100 


0 

5 

2 

10 


"1 

2 

2 

10 


"1 

2 

0 

250/33" 


"1 

0 

0 

50/11" 

0 

1 

3/2 

10/3 

~ 

0 

1 

0 

50/33 

~ 

0 

1 

0 

50/33 

0 

0 

1 

40/33 


0 

0 

1 

40/33 


0 

0 

1 

40/33 


' 50/11" 


"4.55“ 


units of Food 1 

50/33 

= 

1.52 

= 

units of Food 2 

40/33 


1.21 


units of Food 3 


5. Loop 1: The resistance vector is 

5 Total of four RI voltage drops for current I 
-2 Voltage drop for / 2 is negative; / 2 flows in opposite direction 
0 Current /_, does not flow in loop 1 

0 Current / does not flow in loop 1 


Loop 2: The resistance vector is 
-2 
11 
-3 


0 . 


Also, r 3 = 


Voltage drop for /j is negative; flows in opposite direction 

Total of four Rl voltage drops for current I 2 

Voltage drop for/., is negative; I 3 flows in opposite direction 

Current / does not flow in loop 2 


“ 0“ 


“ 0“ 



5 

-2 

0 

0 

-3 

, r 4 = 

0 

, and R = [it 

r 2 1*3 1*4] = 

-2 

11 

-3 

0 

17 


-4 


0 

-3 

17 

-4 

_-4_ 


_25_ 



_ 0 

0 

-4 

25_ 


Notice that each off-diagonal entry of R is negative (or zero). This happens because the loop current 
directions are all chosen in the same direction on the figure. (For each loop j, this choice forces the 
currents in other loops adjacent to loop j to flow in the direction opposite to current /,.) 

40 n 


Next, set v = 


-30 

20 

-10 


. The voltages in loops 2 and 4 are negative because the battery orientation in each 


loop is opposite to the direction chosen for positive current flow. Thus, the equation Ri = v becomes 
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5 

-2 

0 

o’ 

A 


" 40* 


A 


7.56 

-2 

11 

-3 

0 

1 2 

— 

-30 

[M] : The solution is i = 

^2 

— 

-1.10 

0 

-3 

17 

-4 

h 


20 

^3 


.93 

_ 0 

0 

-4 

25_ 

h_ 


.-10. 


Ja_ 


. -.25. 


6. Loop 1: The resistance vector is 


r i = 


4 

-1 

0 

0 


Total of four RI voltage drops for current / 

Voltage drop for/ 2 is negative; / 2 flows in opposite direction 
Current / 3 does not flow in loop 1 
Current / does not flow in loop 1 


Loop 2: The resistance vector is 


-1 

6 

-2 

0 


Voltage drop for I is negative; I flows in opposite direction 
Total of four RI voltage drops for current / 2 
Voltage drop for/., is negative; I flows in opposite direction 
Current / does not flow in loop 2 


Also, r 3 


“ 0“ 


' 0“ 


40" 

-2 


0 


30 

10 

, 1*4 = 

-3 

, and R = [ri r 2 r 3 r 4 ]. Set v = 

20 

-3 


12 


10 


. Then Ri 


' 4 

-1 

0 

0" 

h 


40 


h 


"12.11" 

-1 

6 

-2 

0 

In 


30 


In 


8.44 





z 

— 


. [M] : The solution is i = 

Z 

= 


0 

-2 

10 

-3 

h 


20 

A 


4.26 

0 

0 

-3 

12 

A. 


10 


A. 


1.90 


v becomes 


7. Loop 1: The resistance vector is 


r = 


12 

-7 

0 

-4. 


Total of three RI voltage drops for current / 

Voltage drop for/ 2 is negative; / 2 flows in opposite direction 
Current / does not flow in loop 1 

Voltage drop for/ is negative; I A flows in opposite direction 


Loop 2: The resistance vector is 


-7 

15 

-6 

0 


Voltage drop for / is negative; I { flows in opposite direction 
Total of three RI voltage drops for current I 2 
Voltage drop for/ 3 is negative; / flows in opposite direction 
Current / does not flow in loop 2 
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Also, r 3 = 


" 0" 


'-4' 



"12 

-7 

0 

-4" 

-6 

14 

, r 4 = 

0 

, and R = [it 

r 2 r 3 r 4 ] = 

-7 

0 

15 

-6 

14 

0 

-5 

—6 

-5 

_-5 


13 



-4 

0 

-5 

13 


Notice that each off-diagonal entry of R is negative (or zero). This happens because the loop current 
directions are all chosen in the same direction on the figure. (For each loop j, this choice forces the 
currents in other loops adjacent to loop j to flow in the direction opposite to current /,.) 


Next, set v 


40 

30 

20 


. Note the negative voltage in loop 4. The current direction chosen in loop 4 is 


-10 


opposed by the orientation of the voltage source in that loop. Thus Ri = v becomes 


"12 

-7 

0 

-4" 

A 


' 40" 


A 


"11.43" 

-7 

15 

-6 

0 

1 2 


30 


/, 


10.55 






— 


. [M] : The solution is i = 

Z 

— 


0 

-6 

14 

-5 

h 


20 

A 


8.04 

-4 

0 

-5 

13 

_h_ 


-10 


A. 


5.84_ 


8. Loop 



1 : 

15 

-5 

0 

-5 

-1 


The resistance vector is 

Total of four R1 voltage drops for current I 

Voltage drop for I 2 is negative; / 2 flows in opposite direction 

Current / 3 does not flow in loop 1 

Voltage drop for / 4 is negative; / 4 flows in opposite direction 
Voltage drop for/ is negative; I flows in opposite direction 


Loop 2: The resistance vector is 


-5 

15 

-5 

0 

- 2 . 


Voltage drop for 1 1 is negative; I x flows in opposite direction 
Total of four RI voltage drops for current I 2 
Voltage drop for/ 3 is negative; I flows in opposite direction 
Current I does not flow in loop 2 

Voltage drop for/ 5 is negative; / flows in opposite direction 


“ 0“ 


“-5“ 


“-1" 


“15 

-5 

0 

-5 

-f 


" 40" 

-5 


0 


-2 


-5 

15 

-5 

0 

-2 


-30 

15 

, r 4 = 

-5 

, r 5 = 

-3 

, and R = 

0 

-5 

15 

-5 

-3 

. Set v = 

20 

-5 


15 


-4 


-5 

0 

-5 

15 

-4 


-10 

-3 


-4 


10 


-1 

-2 

-3 

-4 

id 


0 


Note the 


negative voltages for loops where the chosen current direction is opposed by the orientation of the 
voltage source in that loop. Thus Ri = v becomes: 
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"15 

-5 

0 

-5 

-f 



“ 40" 


h 


"3.37" 

-5 

15 

-5 

0 

-2 

1 2 


-30 


1 2 


.11 

0 

-5 

15 

-5 

-3 

h 

= 

20 

. [M] The solution is 

h 

= 

2.27 

-5 

0 

-5 

15 

-4 

u 


-10 


h 


1.67 

-1 

-2 

-3 

-4 

10 

_h_ 


0 


h_ 


1.70 


9 . The population movement problems in this section assume that the total population is constant, with no 
migration or immigration. The statement that “about 5% of the city’s population moves to the suburbs” 
means also that the rest of the city’s population (95%) remain in the city. This determines the entries in 
the first column of the migration matrix (which concerns movement from the city). 

From: 

City Suburbs To: 

.95 City 

.05 Suburbs 


Likewise, if 4% of the suburban population moves to the city, then the other 96% remain in the suburbs. 


This determines the second column of the migration matrix:, M = 


.95 

.05 


.04 

.96 


. The difference equation is 


\ k+ \ = M\ k for k = 0, 1,2, .... Also, x 0 = 


600,000 

400,000 


The population in 2001 (when k = 1) is Xi = Mx 0 = 
The population in 2002 (when k = 2) is x 2 = M\\ = 


'.95 

.04" 

"600,000" 


"586,000" 

.05 

.96 

400,000 


414,000 

'.95 

.04" 

"586,000" 


"573,260" 

.05 

.96 

414,000 


426,740 


10 . The data in the first sentence implies that the migration matrix has the form: 
From: 


City Suburbs 
.03" 
.07 


To: 

City 

Suburbs 


The remaining entries are determined by the fact that the numbers in each column must sum to 1 
instance, if 7% of the city people move to the suburbs, then the rest, or 93%, remain in the city.) 


migration matrix is M = 


.93 .03 

.07 .97 


. The initial population is x 0 = 


800,000 

500,000 


The population in 2001 (when k - 1) is x x = Mx 0 = 
The population in 2002 (when k- 2) is x 2 = Mx\ = 


'.93 

.03" 

"800,000" 


"759,000" 

.07 

.97_ 

500,000 


541,000 

'.93 

.03" 

"759,000" 


"722,100" 

.07 

.91 _ 

541,000 


577,900 


. (For 
So the 


11. The problem concerns two groups of people-those living in California and those living outside California 
(and in the United States). It is reasonable, but not essential, to consider the people living inside 
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California first. That is, the first entry in a column or row of a vector will concern the people living in 
California. With this choice, the migration matrix has the form: 

From: 

Calif. Outside To: 

Calif. 

Outside 


a. For the first column of the migration matrix M, compute 


f Calif, personsl 
[who moved J 

{Total Calif, pop.} 


509,500 

29,726,000 


=.017146 


The other entry in the first column is 1 - .017146 = .982854. The exercise requests that 5 decimal 
places be used. So this number should be rounded to .98285. Whatever number of decimal places 
is used, it is important that the two entries sum to 1. So, for the first fraction, use .01715. 


} outside personsl 

, [ who moved J 

For the second column ofM, compute - 

{Total outside pop.} 

is 1 - .00258 = .99742. Thus, the migration matrix is 


564,100 

218,994,000 


= .00258 . The other entry 


From: 


Calif. 

".98285 

.01715 


Outside 

.00258" 

.99742 


To: 

Calif. 

Outside 


b. [M] The initial vector is x 0 = (29.716, 218.994), with data in millions of persons. Since x 0 describes 
the population in 1990, and Xi describes the population in 1991, the vector xi 0 describes the projected 
population for the year 2000, assuming that the migration rates remain constant and there are no 
deaths, births, or migration. Flere are some of the vectors in the calculation, with only the first 4 or 5 
figures displayed. Numbers are in millions of persons: 


' 29.7" 

' 29.8" 

' 29.8" 


30.1" 

' 30.18" 

30.223" 

219.0 : 

’[218.9 : 

’[218.9 

9***9 

218.6 : 

’[218.53 1 

’[218.487 



'.97 

.05 

.10" 


"305" 


'.97 

.05 

.10 

"305" 


"308" 

12. Set M = 

.00 

.90 

.05 

and x 0 = 

48 

. Then xi = 

.00 

.90 

.05 

48 

~ 

48 


.03 

.05 

.85 


98 


.03 

.05 

.85 

98 


95 



'.97 

.05 

.10" 

"308" 


"311" 


x 2 = 

.00 

.90 

.05 

48 

~ 

48 

. The entries in x 2 give the approximate distribution of cars on 


.03 

.05 

.85 

95 


92 



Wednesday, two days after Monday. 


13. [M] The order of entries in a column of a migration matrix must match the order of the columns. For 
instance, if the first column concerns the population in the city, then the first entry in each column must 
be the fraction of the population that moves to (or remains in) the city. In this case, the data in the 


exercise leads to M = 


.95 

.05 


.03 

.97 


and x 0 : 


600,000 

400,000 
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a. Some of the population vectors are 


"523,293“ 


"472,737" 


"439,417" 


“417,456" 

_476,707_ 

5 X 10 “ 

_527,263_ 

5 X 15 _ 

560,583 

! X 20 — 

_582,544_ 


b. 


The data here shows that the city population is declining and the suburban popidation is increasing, 
but the changes in population each year seem to grow smaller. 

"350,000“ 


When x 0 : 


650,000 


the situation is different. Now 


"358,523“ 


"364,140“ 


“367,843“ 


“370,283" 

_641,477_ 

» X 10 “ 

635,860 

» X 15 — 

_632,157_ 

» X 20 — 

629,717_ 


The city population is increasing slowly and the suburban population is decreasing. No other 
conclusions are expected. (This example will be analyzed in greater detail later in the text.) 


14 . Here are Figs, (a) and (b) for Exercise 13, followed by the figure for Exercise 34 in Section 1.1: 


20 " 20 ° 



l 

2 


4 

3 





20 ° 20 ° 


0 ° 0 ° 



1 

2 


4 

3 





10 ° 10 ° 


40° 

40° 


20 ° 20 ' 



1 

2 


4 

3 





30° 30' 


40' 

40' 


(a) 


(b) 


Section 1.1 


For Fig. (a), the equations are: 

47] = 0 + 20 + 7] + 7] 

4 7] =7] +20 + 0 + 7] 

47] =r 4 +7] +0 + 20 
47] =0 + 7] +7] +20 

To solve the system, rearrange the equations and row reduce the augmented matrix. Interchanging rows 1 
and 4 speeds up the calculations. The first five steps are shown in detail. 


~ 4 

-1 

0 

-1 

20 " 


1 

0 

1 

-4 

- 20 ~ 


" 1 

0 

1 

-4 

-20 ~ 


’ 1 

0 

1 

-4 

- 20 ~ 

-1 

4 

-1 

0 

20 


-1 

4 

-1 

0 

20 


0 

4 

0 

-4 

0 


0 

1 

0 

-1 

0 

0 

-1 

4 

-1 

20 


0 

-1 

4 

-1 

20 


0 

-1 

4 

-1 

20 


0 

-1 

4 

-1 

20 

_-l 

0 

-1 

4 

20 _ 


_ 4 

-1 

0 

-1 

20 _ 


_0 

-1 

-4 

15 

100 _ 


_0 

-1 

-4 

15 

100 _ 


i 

0 

1 

-4 

-20" 


"l 

0 

1 

-4 

-20 " 


"l 

0 

0 

0 

10 

0 

1 

0 

-1 

0 


0 

1 

0 

-1 

0 


0 

1 

0 

0 

10 

0 

0 

4 

-2 

20 


0 

0 

4 

-2 

20 


0 

0 

1 

0 

10 

0 

0 

-4 

14 

100 


0 

0 

0 

12 

120 


0 

0 

0 

1 

10 
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For Fig (b), the equations are 

4Fj = 10 + o +r 2 +r 4 
4r 2 =t { + o + 40+r 3 
4T 3 =T 4 + T 2 +40 + 10 

4r 4 =10+ j; +r 3 +10 

Rearrange the equations and row reduce the augmented matrix: 


" 4 

-1 

0 

-1 

10~ 


"l 

0 

0 

0 

10 ' 

-1 

4 

-1 

0 

40 


0 

1 

0 

0 

17.5 

0 

-1 

4 

-1 

50 


0 

0 

1 

0 

20 

_-l 

0 

-1 

4 

20_ 


_0 

0 

0 

1 

12. 5_ 


a. Flere are the solution temperatures for the three problems studied: 

Fig. (a) in Exercise 14 of Section 1.10: (10, 10, 10, 10) 

Fig. (b) in Exercise 14 of Section 1.10: (10, 17.5, 20, 12.5) 

Figure for Exercises 34 in Section 1.1 (20, 27.5, 30, 22.5) 

When the solutions are arranged this way, it is evident that the third solution is the sum of the first 
two solutions. What might not be so evident is that list of boundary temperatures of the third problem 
is the sum of the lists of boundary temperatures of the first two problems. (The temperatures are listed 
clockwise, starting at the left of 7).) 

Fig. (a): ( 0, 20, 20, 0, 0, 20, 20, 0) 

Fig. (b): (10, 0, 0,40,40,10,10,10) 

Fig. from Section 1.1: (10, 20, 20, 40, 40, 30, 30, 10) 

b. When the boundary temperatures in Fig. (a) are multiplied by 3, the new interior temperatures are 
also multiplied by 3. 

c. The correspondence from the list of eight boundary temperatures to the list of four interior temper- 
atures is a linear transformation. A verification of this statement is not expected. Flowever, it can be 
shown that the solutions of the steady-state temperature problem here satisfy a superposition 
principle. The system of equations that approximate the interior temperatures can be written in the 
form Ax = b, where A is determined by the arrangement of the four interior points on the plate and b 
is a vector in R 4 determined by the boundary temperatures. 

Note: The MATLAB box in the Study Guide for Section 1.10 discusses scientific notation and shows how 
to generate a matrix whose columns list the vectors x 0 , Xi, x 2 , ..., determined by an equation x k , i = Mx k for 
k = 0 , 1, 

Chapter 1 SUPPLEMENTARY EXERCISES 

1. a. False. (The word “reduced” is missing.) Counterexample: 



"1 2" 


"1 

2" 


"1 2" 

A = 

3 4 

, B = 

0 

-2 

, c = 

0 1 


The matrix A is row equivalent to matrices B and C, both in echelon form. 



Chapter 1 • Supplementary Exercises 


77 


b. False. Counterexample: Let A be any n xn matrix with fewer than n pivot columns. Then the equation 
Ax = 0 has infinitely many solutions. (Theorem 2 in Section 1.2 says that a system has either zero, 
one, or infinitely many solutions, but it does not say that a system with infinitely many solutions 
exists. Some counterexample is needed.) 

c. True. If a linear system has more than one solution, it is a consistent system and has a free variable. 

By the Existence and Uniqueness Theorem in Section 1.2, the system has infinitely many solutions. 

d. False. Counterexample: The following system has no free variables and no solution: 

X 1 + x 2 = 1 

x 2 = 5 

X l + X 2 = 2 

e. True. See the box after the definition of elementary row operations, in Section 1.1. If \A b] is 
transformed into [C d] by elementary row operations, then the two augmented matrices are row 
equivalent. 

f. True. Theorem 6 in Section 1 .5 essentially says that when Ax = b is consistent, the solution sets of the 
nonhomogeneous equation and the homogeneous equation are translates of each other. In this case, 
the two equations have the same number of solutions. 

g. False. For the columns of A to span R" ! , the equation Ax = b must be consistent for all b in R m , not for 
just one vector b in R m . 

h. False. Any matrix can be transformed by elementary row operations into reduced echelon form, but 
not every matrix equation Ax = b is consistent. 

i. True. If A is row equivalent to B , then A can be transformed by elementary row operations first into B 
and then further transformed into the reduced echelon form U of B. Since the reduced echelon form of 
A is unique, it must be U. 

j. False. Every equation Ax = 0 has the trivial solution whether or not some variables are free. 

k. True, by Theorem 4 in Section 1 .4. If the equation Ax = b is consistent for every b in R m , then A must 
have a position in every one of its m rows. If A has m pivot positions, then A has m pivot columns, 
each containing one pivot position. 

l. False. The word “unique” should be deleted. Let A be any matrix with m pivot columns but more than 
m columns altogether. Then the equation Ax = b is consistent and has m basic variables and at least 
one free variable. Thus the equation does not does not have a unique solution. 

m. True. If A has n pivot positions, it has a pivot in each of its n columns and in each of its n rows. The 
reduced echelon form has a 1 in each pivot position, so the reduced echelon form is the n x« identity 
matrix. 

n. True. Both matrices A and B can be row reduced to the 3><3 identity matrix, as discussed in the 
previous question. Since the row operations that transform B into /? are reversible, A can be 
transformed first into / 3 and then into B. 

o. True. The reason is essentially the same as that given for question f. 

p. True. If the column s of A span R m , then the reduced echelon form of A is a matrix U with a pivot in 
each row, by Theorem 4 in Section 1.4. Since B is row equivalent to A, B can be transformed by row 
operations first into A and then further transformed into U. Since (/has a pivot in each row, so does 
B. By Theorem 4, the columns of B span R" ! . 

q. False. See Example 5 in Section 1.6. 

r. True. Any set of three vectors in R 2 would have to be linearly dependent, by Theorem 8 in 
Section 1.6. 
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s. False. If a set {vi, v 2 , v 3 , v 4 } were to span R 5 , then the matrix A = [v, v 2 v 3 v 4 ] would have 
a pivot position in each of its five rows, which is impossible since A has only four columns. 

t. True. The vector -u is a linear combination of u and v, namely, -u = (-l)u + Ov. 

u. False. If u and v are multiples, then Span{u, v} is a line, and w need not be on that line. 

v. False. Let u and v be any linearly independent pair of vectors and let w = 2v. Then w = Ou + 2v, so w 
is a linear combination of u and v. However, u cannot be a linear combination of v and w because if it 
were, u would be a multiple of v. That is not possible since {u, v} is linearly independent. 

w. False. The statement would be true if the condition Vi is not zero were present. See Theorem 7 in 
Section 1.7. However, if v 3 = 0, then {vi, v 2 , v 3 } is linearly dependent, no matter what else might be 
true about v 2 and v 3 . 

x. True. “Function” is another word used for “transformation” (as mentioned in the definition of 
“transformation” in Section 1.8), and a linear transformation is a special type of transformation. 

y. True. For the transformation x i-» Ax to map R 5 onto R 6 , the matrix A would have to have a pivot in 
every row and hence have six pivot columns. This is impossible because A has only five columns. 

z. False. For the transformation x i— > Ax to be one-to-one, A must have a pivot in each column. Since 
A has « columns and m pivots, m might be less than n. 


2. If a ^ 0, thenx = b!a\ the solution is unique. If a = 0, and b ^ 0, the solution set is empty, because 
Ox = 0 ^ b. If a = 0 and b = 0, the equation Ox = 0 has infinitely many solutions. 

3. a. Any consistent linear system whose echelon form is 


~B 

* 

* 

* 


~B 

* 

* 

* 


“0 

B 

* 

* 

0 

B 

* 

* 

or 

0 

0 

B 

* 

or 

0 

0 

B 

* 

0 

0 

0 

0 


0 

0 

0 

0 


0 

0 

0 

0 


b. Any consistent linear system whose coefficient matrix has reduced echelon form / 3 . 

c. Any inconsistent linear system of three equations in three variables. 


4. Since there are three pivots (one in each row), the augmented matrix must reduce to the form 
^ * * * 

OB** . A solution of Ax = b exists for all b because there is a pivot in each row of A. Each 
0 0 B * 

solution is unique because there are no free variables. 


5. a. 


"1 

3 

k 

j 

4 

h 

8 



3 

A -12 


k 

! — 4 k 


. If/7 


12 and k ^ 2, the second row of the augmented matrix 


indicates an inconsistent system of the form 0x 2 = b, with b nonzero. If h= 12, and k = 2, there is only 
one nonzero equation, and the system has infinitely many solutions. Finally, if h ^ 12, the coefficient 
matrix has two pivots and the system has a unique solution. 


b. 


"-2 

h 

1 “ 


r@ 

h 

l 

6 

k 

-2 


0 

k + 3h 

1 


. If/- + 3/7 


0, the system is inconsistent. Otherwise, the 


coefficient matrix has two pivots and the system has a unique solution. 
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6. a. Set v, = 


» V 2 = 


-2 

-3 


. V 3 = 


7 

10 


and b = 


-5 

-3 


. “Determine if b is a linear combination of Vi, \ 2 , 


V 3 .” Or, “Determine if b is in Span{vi, V 2 , V 3 }.” To do this, compute 


4-2 7-5 

8 -3 10 -3 


b. Set ,4 


4-2 7 

8 -3 10 


3) -2 7-5 

0 0 -4 7 

'-5' 


. The system is consistent, so b is in Span{vi, V 2 , V 3 }. 


, b = 


-3 


. “Determine if b is a linear combination of the columns of A.” 


c. Define T(x) = Ax. “Determine if b is in the range of T.” 


7. a. Set V! = 

' 2" 
-5 

> v 2 = 

'-4' 

1 

> V 3 = 

"-2" 

1 

and b = 

*cT ^ 

1 


7 


-5 


-3 


_* 3 J 


‘Determine if Vi, V 2 , V 3 span R 3 .” To do this, row 


reduce [vi V2 V3]: 


1 

(N 

1 

^t" 

1 

<N 
1 


1 

<N 

1 

^t" 

1 

<N 
1 


(2) -4 —2 "1 

-5 1 1 

~ 

0 -9 -4 

~ 

O 

© 

1 

■4^ 

7 -5 -3 


1 

^1" 

os 

0 

1 


0 0 oj 


. The matrix does not have a pivot in each row, so 


its columns do not span R 3 , by Theorem 4 in Section 1.4. 

2 -4 -2 

b. Set ^4 = | — 5 1 1 . “Determine if the columns of A span R 3 .” 

7 -5 -3 

c. Define T(x) = Ax. “Determine if T maps R 3 onto R 3 .” 











■ 

* 

* 



He He 



* 

He 


“0 

■ *" 





8. a. 

0 

■ * 

9 

0 

0 

■ 

9 

0 

0 ■ 

b. 

0 

■ 

* 












0 

0 

■ 


9. The first line is the line spanned by 
as the sum of a multiple of 


. The second line is spanned by 


So the problem is to write 


and a multiple of 


. That is, find x\ and vy such that 


“2“ 


"f 


“5" 


+ x 2 


= 


1 


2 


6 


Reduce the augmented matrix for this equation: 


“2 1 5" 


“1 

2 

6 “ 


“1 

2 

6 " 


“1 

2 

6 “ 


“1 

0 

4/3“ 

1 2 6 


2 

1 

5_ 


0 

-3 

-7_ 


0 

1 

7/3_ 


0 

1 

7 / 3_ 


Thus, 


“5“ 

4 

"2" 

7 

"1" 


“5“ 


"8/3" 


' 7/3" 




+ — 


or 


= 


+ 


6 

-3 

1 

3 

2 


6 


_4/3_ 


14/3 


10. The line through and the origin and the line through a 2 and the origin determine a “grid” on the 

xiX 2 -plane as shown below. Every point in R 2 can be described uniquely in terms of this grid. Thus, b can 
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be reached from the origin by traveling a certain number of units in the a! -direction and a certain number 
of units in the a 2 -direction. 



11. A solution set is a line when the system has one free variable. If the coefficient matrix is 2x3, then two of 

' 12 *' 

the columns should be pivot columns. For instance, take 


0 3 


. Put anything in column 3. The 


resulting matrix will be in echelon form. Make one row replacement operation on the second row to 


create a matrix not in echelon form, such as 


1 2 1 
0 3 1 


1 2 1 
1 5 2 


12. A solution set is a plane where there are two free variables. If the coefficient matrix is 2x3, then only one 
column can be a pivot column. The echelon form will have all zeros in the second row. Use a row 


replacement to create a matrix not in echelon form. For instance, let A = 


1 

1 


2 3 
2 3 



"1 

0 

*“ 




The reduced echelon form of A looks like E = 

0 

1 

* 

. Since E is 


0 

0 

0 





"1 

0 

*“ 

3' 


"O' 

Ex = 0 has the same solutions as Ax = 0. Thus 

0 

1 

* 

-2 

= 

0 


0 

0 

0 

1 


0 


equivalent to A, the equation 


By inspection, 



0 

1 

0 


-3 

2 

0 


14. Row reduce the augmented matrix for x t 


T 


a 


" 0 " 


+ x 2 


= 


a 


ci + 2 


0 


(*)• 


1 a 0 


1 a 

O' 


'1 

a 0 

a a + 2 0 


0 a + 2 — a ~ 

0 


0 

(2-a)(l + a) 0 


The equation (*) has a nontrivial solution only when (2 - a)( 1 + a) = 0. So the vectors are linearly 
independent for all a except a = 2 and a = -1 . 


15. a. If the three vectors are linearly independent, then a, c, and / must all be nonzero. (The converse is 
true, too.) Let A be the matrix whose columns are the three linearly independent vectors. Then 
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A must have three pivot columns. (See Exercise 30 in Section 1 .7, or realize that the equation Ax = 0 
has only the trivial solution and so there can be no free variables in the system of equations.) Since 
A is 3x3, the pivot positions are exactly where a, c, and / are located. 

b. The numbers a, . . .,/ can have any values. Here's why. Denote the columns by Vi, v 2 , and v 3 . Observe 
that Vi is not the zero vector. Next, v 2 is not a multiple of Vi because the third entry of v 2 is nonzero. 
Finally, v 3 is not a linear combination of Vi and v 2 because the fourth entry of v 3 is nonzero. By 
Theorem 7 in Section 1.7, {vi, v 2 , v 3 } is linearly independent. 

16. Denote the columns from right to left by vj, . . ., V 4 . The “first” vector v 3 is nonzero, v 2 is not a multiple of 
Vi (because the third entry of v 2 is nonzero), and v 3 is not a linear combination of Vi and v 2 (because the 
second entry of v 3 is nonzero). Finally, by looking at first entries in the vectors, V 4 cannot be a linear 
combination of Vi, v 2 , and v 3 . By Theorem 7 in Section 1.7, the columns are linearly independent. 

17. Here are two arguments. The first is a “direct” proof. The second is called a “proof by contradiction.” 

i. Since {vi, v 2 , v 3 } is a linearly independent set, Vi ^ 0. Also, Theorem 7 shows that v 2 cannot be a 
multiple of Vi, and v 3 cannot be a linear combination of Vi and v 2 . By hypothesis, V 4 is not a linear 
combination of Vi, v 2 , and v 3 . Thus, by Theorem 7, {vi, v 2 , v 3 , V 4 } cannot be a linearly dependent set 
and so must be linearly independent. 

ii. Suppose that {vi, v 2 , v 3 , V 4 } is linearly dependent. Then by Theorem 7, one of the vectors in the set is 
a linear combination of the preceding vectors. This vector cannot be V 4 because V 4 is not in Span{vi, 
v 2 , v 3 }. Also, none of the vectors in {vi, v 2 , v 3 } is a linear combinations of the preceding vectors, by 
Theorem 7. So the linear dependence of {vi, v 2 , v 3 , v 4 } is impossible. Thus {vi, v 2 , v 3 , v 4 } is linearly 
independent. 

18. Suppose that c\ and c 2 are constants such that 

C 1 V 1 + c 2 (v \ + v 2 ) = 0 (*) 

Then (ci + c 2 )vi + c 2 v 2 = 0. Since Vi and v 2 are linearly independent, both c\ + c 2 = 0 and c 2 = 0. It 
follows that both c\ and c 2 in (*) must be zero, which shows that {vi, v 3 + v 2 } is linearly independent. 

19. Fet M be the line through the origin that is parallel to the line through vi, v 2 , and v 3 . Then v 2 - Vi and 

v 3 - vi are both on M. So one of these two vectors is a multiple of the other, say v 2 - Vi = /f(v 3 - vi). This 
equation produces a linear dependence relation ( k - l)vi + v 2 - /cv 3 = 0 . 

A second solution: A parametric equation of the line is x = Vi + t(x 2 - Vi). Since v 3 is on the line, there is 
some to such that v 3 = v 3 + to(v 2 - v 3 ) = (1 - to)V] + toV 2 . So v 3 is a linear combination of Vi and v 2 , and 
{vi, v 2 , v 3 } is linearly dependent. 

20 . If r(u) = v, then since T is linear, 

T(-u) = T((-l)u) = (-l)T(u) = -v. 

21. Either compute 7'(ei), 7)e 2 ), and T(e 3 ) to make the columns of A, or write the vectors vertically in the 
definition of T and fill in the entries of A by inspection: 



"? 

? 

f 

x \ 


X 1 


"1 

0 

0 " 

Ax = 

? 

A 

? 

x 2 

= 

X 2 

, A = 

0 

-1 

0 


? 

? 

? 

_ X 3 _ 


X 3 _ 


0 

0 

1 


22. By Theorem 12 in Section 1.9, the columns of A span R 3 . By Theorem 4 in Section 1 .4, A has a pivot in 
each of its three rows. Since A has three columns, each column must be a pivot column. So the equation 
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Ax - 0 has no free variables, and the columns of A are linearly independent. By Theorem 12 in Section 
1.9, the transformation x i-» Ax is one-to-one. 


23 . 


a 

-b 

~4 


"5" 

b 

a 

_3_ 


0 


implies that 


4 a - 
3a + 


3b 
4 b 


= 5 
= O' 


. Solve: 


4 

-3 

5 “ 


"4 

-3 

5 


'4-3 5 


"4 

0 

16/5“ 


“1 

0 

4/5“ 

3 

4 

0 


0 

25/4 

-15/4 


0 1 — 3/ 5_ 


0 

1 

— 3 / 5_ 


0 

1 

— 3/ 5_ 


Thus a = 4/5 and b = -3/5. 


24. The matrix equation displayed gives the information 2a - 4b = 2y[5 and 4a + 2b = 0. Solve for a and b: 


1 

to 

1 

to 


2 -4 2V5 


"l-2 s[5 " 


"1 0 l/VT 

4 2 0 


1 

O 

O 

1 


0 1 - 2 /V 5 


0 1 - 2 /V 5 


So a = 1/V5, b = -2/\[5. 


25. a. The vector lists the number of three-, two-, and one-bedroom apartments provided whenxi floors of 
plan A are constructed. 



“3“ 


"4" 


“5“ 

b. Xj 

7 

+ x 2 

4 

+ x 3 

3 


8 


8 


9 



“3“ 


"4" 


“5“ 


66 

c. [M] Solve x. 

7 

+ x 2 

4 

+ x 3 

3 

= 

74 


8 


8 


9 


136 


“3 

4 

5 

66 


“1 

0 

-1/2 

2“ 

Xj - (1 / 2)x 3 

= 2 

7 

4 

3 

74 

— 

0 

1 

13/8 

15 

x 2 + (13/ 8)x 3 

= 15 

8 

8 

9 

136 


0 

0 

0 

0 

0 

= 0 


The general solution is 



Xi 


“ 2 + (1/ 2)x 3 " 


“ 2“ 


“ 1/2 " 

x = 

x 2 

= 

15 — (13/ 8)x 3 

= 

15 

+ x 3 

-13/8 


_ X 3. 


x 3 


0 


1 


However, the only feasible solutions must have whole numbers of floors for each plan. Thus, x 3 must 
be a multiple of 8, to avoid fractions. One solution, for x 3 = 0, is to use 2 floors of plan A and 15 
floors of plan B. Another solution, for x 3 = 8, is to use 6 floors of plan A , 2 floors of plan B, and 8 
floors of plan C. These are the only feasible solutions. A larger positive multiple of 8 for x 3 makes x 2 
negative. A negative value for jt 3 , of course, is not feasible either. 
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Matrix 

Algebra 


2.1 SOLUTIONS 

Notes: The definition here of a matrix product AB gives the proper view of AB for nearly all matrix 
calculations. (The dual fact about the rows of A and the rows of AB is seldom needed, mainly because vectors 
here are usually written as columns.) I assign Exercise 13 and most of Exercises 17-22 to reinforce the 
definition of AB. 

Exercises 23 and 24 are used in the proof of the Invertible Matrix Theorem, in Section 2.3. Exercises 
23-25 are mentioned in a footnote in Section 2.2. A class discussion of the solutions of Exercises 23-25 can 
provide a transition to Section 2.2. Or, these exercises could be assigned after starting Section 2.2. 

Exercises 27 and 28 are optional, but they are mentioned in Example 4 of Section 2.4. Outer products also 
appear in Exercises 3 1-34 of Section 4.6 and in the spectral decomposition of a symmetric matrix, in Section 7. 1 . 
Exercises 29-33 provide good training for mathematics majors. 


1. -24 = (-2) 


2 0-1 
4-5 2 


-4 0 2 

-8 10 -4 


. Next, use B -2A= B + (—24): 



"7 -5 

f 


'-4 

0 

2 


3 

-5 

3' 

II 

CN 

1 

cq 

1 -4 

-3 

+ 

-8 

10 

—4 

— 

-7 

6 

-7 


The product AC is not defined because the number of columns of 4 does not match the number of rows 

For mental computation, the 


of C. CD = 

row-column rule is probably easier to use than the definition 


1 2 

' 3 5' 


r 1 • 3 + 2(-l) 

1-5 + 2-4' 


1 13' 

2 1 

-1 4 


-2-3 + l(-l) 

-2 • 5 + 1 • 4 


-7 -6 



'2 

0 

-f 


"7 -5 

f 


'2 + 14 

0-10 

-1 + 2' 


'16 

-10 ll 

2. 4 + 25 = 

4 

-5 

2 

+ 2 

1 -4 

-3 

— 

4 + 2 

oo 

1 

in 

1 

2-6 

— 

6 

^l" 

1 

CO 

7 


The expression 3C - E is not defined because 3 C has 2 columns and -E has only 1 column. 


1 2' 

'7 -5 T 


' 1- 7 + 2-1 1(— 5) + 2(-4) 1 - 1 + 2( — 3) 


9 -13 -5' 

-2 1 

1 -4 -3_ 


-2 • 7 + 1 • 1 — 2(— 5) + 1(-4) -2 1 + 1(-3) 


1 

U) 

Os 

1 


The product EB is not defined because the number of columns of E does not match the number of rows 
of R. 


83 
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3. 3 1 2 -A = 


3 0“ 


"4 -1" 


"3-4 0-(-l)" 


r-> >i 

0 3 


1 

1 

to 
1 


0-5 3 - (-2) 


IT) ' 

IT) 

1 

1 


(3I 2 )A = 3(I 2 A) = 3 


"4 

-l" 


"12 

-3" 

_5 

-2 


15 

-6 


or 


(3 1 2 )A = 


3 0" 

"4 -f 


"3-4 + 0 3(-l) + 0 


"12 -3" 

0 3 

.5 “2. 


0 + 3-5 0 + 3(— 2)_ 


15 -6 


' 9 

-1 

3“ 


"5 

0 

0“ 


" 4 

-1 

3" 

-8 

7 

-6 

- 

0 

5 

0 

= 

-8 

2 

-6 

-4 

1 

8 


0 

0 

5 


-4 

1 

3 



~ 9 

-1 

3“ 


" 45 

-5 

15" 

(5I 3 )A = 5(I 3 A) = 5A = 5 

-8 

7 

-6 

= 

-40 

35 

-30 


-4 

1 

8 


-20 

5 

40 



"5 

0 

0 " 

' 9 

-1 

3" 

(5 1 3 )A = 

0 

5 

0 

-8 

7 

-6 


0 

0 

5 

-4 

1 

8 


5-9 + 0 + 0 

5( — 1) + 0 + 0 

5 • 3 + 0 + 0 


0 + 5(-8) + 0 

0 + 5-7 + 0 

0 + 5(-6) + 0 

= 

0 + 0 + 5(-4) 

0 + 0 + 5 • 1 

0 + 0 + 5 • 8 



45 

-5 

15 

-45 

35 

-30 

-20 

5 

40 


5. a. Ab 



AB = [Ab { Ab 2 ] 


-7 4 

7 -6 

12 -7 



-1 • 3 + 2(— 2) 
5 • 3 + 4(-2) 
2 • 3 - 3(-2) 


6. a. 4b, 


-1 -2 
-3 0 

3 5 


0 

-3 

13 


^b 2 = 


^5 = [Jb! Ab 2 ] = 


b. 


' 4 

-2" 





“1 3" 


-3 

0 

2 -1 

— 

3 

5 




0 14 

-3 -9 

13 4 

4 • 1 -2 • 2 
-3 • 1 + 0 • 2 
3-1 + 5-2 


— 1( — 2) + 2-1 


'-7 4" 

5( — 2) + 4-1 

= 

7 -6 

2(-2) -3-1 


12 -7 


' 4 

-2" 



"14" 



' 3" 



-3 

0 

-1 

— 

-9 

3 

5 



4 


4-3 — 2( — 1) 


“ 0 

14" 

-3 - 3 + 0(— 1) 

= 

-3 

-9 

3 - 3 + 5(— 1) 


13 

4 
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7. Since A has 3 columns, B must match with 3 rows. Otherwise, AB is undefined. Since AB has 7 columns, 
so does B. Thus, B is 3><7. 


8. The number of rows of B matches the number of rows of BC, so B has 3 rows. 


" 2 5' 

"4 -5' 


"23 

-10 + 5k 

, while BA = 

"4 

-5" 

' 2 

5" 


23 15 

-3 1 

_ 3 k 


-9 

1 5 + k 


3 

k 

-3 

1 


6-3 k 15 + k 


9. AB = 

Then AB = BA if and only if — 1 0 + 5k= 15 and -9 = 6- 3k, which happens if and only if k= 5. 


" 2 

-3" 

"8 4" 

= 

1 -7" 

, AC = 

~ 2 

-3" 

"5 -2" 

= 

1 -7" 

-4 

6 

_5 5_ 


-2 14_ 

-4 

6 

3 1 


-2 14_ 



"1 

1 

f 

"2 

0 

o' 


"2 

3 

5" 

11. AD = 

1 

2 

3 

0 

3 

0 

= 

2 

6 

15 


1 

4 

5 

0 

0 

5 


2 

12 

25 



"2 

0 

0 " 

"1 

1 

f 


"2 

2 

2" 

DA = 

0 

3 

0 

1 

2 

3 

= 

3 

6 

9 


0 

0 

5 

1 

4 

5 


5 

20 

25 


Right-multiplication (that is, multiplication on the right) by the diagonal matrix D multiplies each column 
of A by the corresponding diagonal entry of D. Left-multiplication by D multiplies each row of A by the 
corresponding diagonal entry of D. To make AB = BA, one can take B to be a multiple of /?. For instance, 
if B = 4/ 3 , then AB and BA are both the same as 4 A. 


12. Consider B = [bi bi]. To make AB = 0, one needs ^4bi = 0 and Ab 2 = 0. By inspection of A, a suitable 



"2" 


"2" 


"2 6" 

bi is 

1 

, or any multiple of 

1 

. Example: B = 

1 3 


13. Use the definition of AB written in reverse order: [A b , • • • A b,,] = A [b 1 • • • b,,]. Thus 
[Qt\ • • • Qr p ] = QR, whenR = [r, • • • r p ]. 


14. By definition, UQ = (7[qi • • • q-t] = [C/qi • • • Uqzt]. From Example 6 of Section 1.8, the vector 

U(\\ lists the total costs (material, labor, and overhead) corresponding to the amounts of products B and 
C specified in the vector qi. That is, the first column of UQ lists the total costs for materials, labor, and 
overhead used to manufacture products B and C during the first quarter of the year. Columns 2, 3, 
and 4 of UQ list the total amounts spent to manufacture B and C during the 2 nd , 3 rd , and 4 th quarters, 
respectively. 

15. a. False. See the definition of AB. 

b. False. The roles of A and B should be reversed in the second half of the statement. See the box after 
Example 3. 

c. True. See Theorem 2(b), read right to left. 

d. True. See Theorem 3(b), read right to left. 

e. False. The phrase “in the same order” should be “in the reverse order.” See the box after Theorem 3. 

16. a. False. AB must be a 3x3 matrix, but the formula for AB implies that it is 3x1. The plus signs should 

be just spaces (between columns). This is a common mistake. 

b. True. See the box after Example 6. 

c. False. The left-to-right order of B and C cannot be changed, in general. 
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d. False. See Theorem 3(d). 

e. True. This general statement follows from Theorem 3(b). 


17. Since 


Ax = 


-1 2 -1 
6-9 3 

-1 


= AB = [Ab { Ab 9 Ab 3 ], the first column of B satisfies the equation 


. Row reduction: [A AbJ 


[A Ab 2 \ 


1 -2 2 
-2 5 -9 


1 -2 -1 
-2 5 6 

1 0 -8 

0 1 -5 


1 0 7 

0 1 4 


. So b. 


. Similarly, 


and bi = 


-5 


Note: An alternative solution of Exercise 17 is to row reduce [A Abi Ab 2 ] with one sequence of row 
operations. This observation can prepare the way for the inversion algorithm in Section 2.2. 


18. The first two columns of AB are Ab\ and Ab 2 . They are equal since bi and b 2 are equal. 

19. (A solution is in the text). Write B = [bi b 2 b 3 ]. By definition, the third column of AB is 4b',. By 
hypothesis, b 3 = bi + b 2 . So Ab 2 = A(b\ + b 2 ) = Abi + Ab 2 , by a property of matrix-vector multiplication. 
Thus, the third column of AB is the sum of the first two columns of AB. 

20. The second column of AB is also all zeros because Ab 2 = AO = 0. 

21. Let b p be the last column of B. By hypothesis, the last column of AB is zero. Thus, Ab p = 0. Flowever, 
b p is not the zero vector, because B has no column of zeros. Thus, the equation Ab p = 0 is a linear 
dependence relation among the columns of A, and so the columns of A are linearly dependent. 

Note: The text answer for Exercise 21 is, “The columns of A are linearly dependent. Why?” The Study Guide 

supplies the argument above, in case a student needs help. 


22. If the columns of B are linearly dependent, then there exists a nonzero vector x such that Bx = 0. From 
this, A(Bx) = AO and (AB)x = 0 (by associativity). Since x is nonzero, the columns of AB must be linearly 
dependent. 

23. If x satisfies Ax = 0, then CAx - CO = 0 and so I„x = 0 and x = 0. This shows that the equation Ax = 0 
has no free variables. So every variable is a basic variable and every column of A is a pivot column. 

(A variation of this argument could be made using linear independence and Exercise 30 in Section 1.7.) 
Since each pivot is in a different row, A must have at least as many rows as columns. 

24. Take any b in R" ! . By hypothesis, ADb = I m b = b. Rewrite this equation as A(Dh) = b. Thus, the 
vector x = Db satisfies Ax = b. This proves that the equation Ax = b has a solution for each b in R m . 

By Theorem 4 in Section 1.4, A has a pivot position in each row. Since each pivot is in a different 
column, A must have at least as many columns as rows. 

25. By Exercise 23, the equation CA = /„ implies that (number of rows in A) > (number of columns), that is, 
m > n. By Exercise 24, the equation AD = I m implies that (number of rows in A) < (number of columns), 
that is, m < n. Thus m = n. To prove the second statement, observe that DAC = ( DA)C = l n C = C, and 
also DAC = D(AC) = DI m = D. Thus C = D. A shorter calculation is 

C = I n C = (. DA)C = D(AQ = DI„ = D 

26. Write A =[ei e 2 e 3 ]andD = [di d 2 d 3 ]. By definition of AD, the equation AD = / 3 is equivalent 

|to the three equations Adi = ei, Ad 2 = e 2 , and Ad 3 = e 3 . Each of these equations has at least one solution 
because the columns of A span R 3 . (See Theorem 4 in Section 1.4.) Select one solution of each equation 
and use them for the columns of D. Then AD = / 3 . 
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27. The product u 7 v is a lxl matrix, which usually is identified with a real number and is written without the 
matrix brackets. 


u r v = [-2 3 -4] 

a 

b 

= -2 a + 3b-4c , v 7 u = [a 

b c] 

'-2' 

3 


c 



-4 


uv r = 

'-2' 

3 

\a 

b c] = 

-2 a 
3 a 

-2b 
3 b 

-2c 

3c 


-4 



-4a 

-4b 

-4c 


T 

VU = 

a 

b 

[-2 3 

-4] = 

-2 a 
-2b 

3 a 
3 b 

-4a 

-4b 


c 



-2c 

3c 

-4c 


28. Since the inner product u r v is a real number, it equals its transpose. That is, 

u r v = (u T \) T = v 7 (u 7 ) 7 = vu, by Theorem 3(d) regarding the transpose of a product of matrices and by 
Theorem 3(a). The outer product uv r is an n xn matrix. By Theorem 3, (uv 7 ) 7 = (v r ) r u r = vu 7 . 


29. The (/,/)-entry of A(B + C) equals the (/,/)-entry of AB + AC, because 

n n n 

X a ik ( b kj + C kj ) = X a ik b kj + X U ik C kj 

k = 1 k = 1 k=l 

The (/,/)-entry of (B + C)A equals the (/,/)-entry of BA + CA, because 

n n n 

X<** +Cik)a k j = Yj b ik a ki + X%% 

k= 1 A-=l A-=l 


30. The (i,j)) -entries of r(AB), ( rA)B , and A(jB) are all equal, because 


r 


Yj a ik b kj =Tj( ra ik) b kj = Tj a ik( rb kj) 


k=l k=l 


k = 1 


31. Use the definition of the product J m A and the fact that I m \ = x for x in R" ! . 

I ft A 4[ai * * * a,,J | A. .a i • • • ] | a i • • • a ;; ] A 


32. Let e, and a ; denote the /th columns of /„ and T, respectively. By definition, the /th column of T/„ is Te ; , 
which is simply a 7 because e, has 1 in the /th position and zeros elsewhere. Thus corresponding columns 
of AI n and A are equal. Hence AI n = A. 


33. The (/,/)-cntry of (AB)' is the (/, f)-entry of AB, which is 
a jA+- + a jn b m 

The entries in row i of B T are b \ „ ... , because they come from column i of B. Likewise, the entries in 
column j of A T are a jU . . ., a Jm because they come from row j of A. Thus the (/,/)-cntry in B r A r is 
a jAi + • ■ ■ + apAn > as above. 


34. Use Theorem 3(d), treating x as an n x 1 matrix: (ABx) r = x T (AB) T = x T B T A T . 

35. [M] The answer here depends on the choice of matrix program. For MATLAB, use the help 
command to read about zeros, ones, eye, and diag. For other programs see the 
appendices in the Study Guide. (The T1 calculators have fewer single commands that produce 
special matrices.) 
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36. [M] The answer depends on the choice of matrix program. In MATLAB, the command rand (6,4) 
creates a 6x4 matrix with random entries uniformly distributed between 0 and 1. The command 

round ( 1 9 * ( rand ( 6 , 4 ) - . 5 ) ) 

creates a random 6x4 matrix with integer entries between -9 and 9. The same result is produced by the 
command randomint in the Laydata Toolbox on text website. For other matrix programs see the 
appendices in the Study Guide. 


37. [M] (A + I)(A -I)- (A 2 - 1 ) = 0 for all 4x4 matrices. However, (A + B)(A - B)-A 2 - B 2 is the zero 
matrix only in the special cases when AB = BA. In general, 

(A + B)(A -B) = A (A -B) + B(A - B) = AA - AB + BA - BB. 


38. [M] The equality ( AB) T = A T B T is very likely to be false for 4x4 matrices selected at random. 

39. [M] The matrix S “shifts” the entries in a vector ( a , b, c, d, e) to yield (b, c, d, e, 0). The entries in S 2 
result from applying S to the columns of S, and similarly for S 2 , and so on. This explains the patterns 
of entries in the powers of S: 


"0 

0 

1 

0 

0 " 


"0 

0 

0 

1 

0 " 


"0 

0 

0 

0 

f 

0 

0 

0 

1 

0 


0 

0 

0 

0 

1 


0 

0 

0 

0 

0 

0 

0 

0 

0 

1 

,S 3 = 

0 

0 

0 

0 

0 


0 

0 

0 

0 

0 

0 

0 

0 

0 

0 


0 

0 

0 

0 

0 


0 

0 

0 

0 

0 

0 

0 

0 

0 

0 


0 

0 

0 

0 

0 


0 

0 

0 

0 

0 


S 5 is the 5x5 zero matrix. S 6 is also the 5x5 zero matrix. 



“.3318 

.3346 

.3336“ 


“.333337 

.333330 

.333333“ 

40. [M] A 5 = 

.3346 

.3323 

.3331 

, A 10 = 

.333330 

.333336 

.333334 


.3336 

.3331 

.3333 


.333333 

.333334 

.333333 


The entries inH 20 all agree with .3333333333 to 9 or 10 decimal places. The entries inH 30 all agree with 
.33333333333333 to at least 14 decimal places. The matrices appear to approach the matrix 


1/3 

1/3 

1/3 

1/3 

1/3 

1/3 

1/3 

1/3 

1/3 


Further exploration of this behavior appears in Sections 4.9 and 5.2. 


Note: The MATLAB box in the Study Guide introduces basic matrix notation and operations, including 
the commands that create special matrices needed in Exercises 35, 36 and elsewhere. The Study Guide 
appendices treat the corresponding information for the other matrix programs. 


2.2 SOLUTIONS 

Notes: The text includes the matrix inversion algorithm at the end of the section because this topic is popular. 
Students like it because it is a simple mechanical procedure. However, I no longer cover it in my classes 
because technology is readily available to invert a matrix whenever needed, and class time is better spent on 
more useful topics such as partitioned matrices. The final subsection is independent of the inversion algorithm 
and is needed for Exercises 35 and 36. 

Key Exercises: 8, 1 1-24, 35. (Actually, Exercise 8 is only helpful for some exercises in this section. 
Section 2.3 has a stronger result.) Exercises 23 and 24 are used in the proof of the Invertible Matrix Theorem 
(IMT) in Section 2.3, along with Exercises 23 and 24 in Section 2.1. I recommend letting students work on 
two or more of these four exercises before proceeding to Section 2.3. In this way students participate in the 
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proof of the IMT rather than simply watch an instructor carry out the proof. Also, this activity will help 
students understand why the theorem is true. 


2 . 


3. 


4. 


i-l 


i—l 


8 6 
5 4 

3 2 
7 4 


8 5 

-7 -5 


1 


32-30 


1 


4 -6 


2 -3 


12-14 


L-5 

8 

1 

[-5/2 

4j 

" 4 

-2' 


"-2 

1 

-7 

3 


_7/2 

-3/2 


L 

" _1 1 

J L 

'-5 -5' 

1 

J 

-5 -5' 


1 

f 

_ -40 -(-35) 

. 7 8 _ 

5 

_ 7 8 _ 

or 

-1.4 

-1.6 


3 -4' 

1 1 

'-8 4 

1 

'-8 4' 

7 ~ 8 _ 

”-24- (-28) 

_-7 3_ 

~4 

-7 3 


or 


-2 1 
-7/4 3/4 


'8 6 
5 4 


and b = 


2 

-1 


5. The system is equivalent to Ax = b, where A = 

. Thus x\ = 7 and x 2 = -9. 


and the solution is 


2 

-3' 

' 2* 


' 7' 

_-5/2 

4_ 

-1 


-9 


x=A b 


6. The system is equivalent to Ax = b, where A = 


8 5 

-7 -5 


and b = 


9 

11 


and the solution is x = A 'b. To 


compute this by hand, the arithmetic is simplified by keeping the fraction l/det(J) in front of the matrix 


for A '. (The Study Guide comments on this in its discussion of Exercise 7.) From Exercise 3, 


x = A 'b = -— 


1 

1 

E/l 

1 

'-9" 

1 

'-10' 


" 2' 

_ 7 8j 

11 

5 

25_ 


_-5_ 


. Thus x\ = 2 and x 2 = -5. 


7. a. 


'l 

2' 

1 

' 12 

-2 

1 

' 12 

-2' 

or 

6 

-l" 

_5 

12 

1-12-2-5 

-5 

1 

~2 

-5 

1 

-2.5 

•5. 


x = A 'bi = — 
2 


1 

to 

1 

_tOj 

'-1' 

1 

-18 


'-9" 

-5 

3 

~ 2 

8 


4 


Similar calculations give 


A~' b 2 = 


11 

-5 


, A~'b 3 - 


6 

-2 


A~' b 4 = 


13 

-5 


b. | A bi b 2 b 3 b 4 ] = 


12-1 12 3 

0 2 8 -10 -4 -10 

1 0-9 11 6 13 

0 1 4 -5 -2 -5 

11 


12-1 12 3 

5 12 3 -5 6 5 

1 2 -1 


1 2 3 

0 1 4 -5 -2 -5 


The solutions are 


-9 

4 


-5 


6 

-2 


, and 


13 

-5 


, the same as in part (a). 
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Note: The Study Guide also discusses the number of arithmetic calculations for this Exercise 7, stating that 
when A is large, the method used in (b) is much faster than using A~ x . 


8. Left-multiply each side of the equation AD = / by A 1 to obtain 
A~ X AD = A~ l I, ID = A~\ and D = A~\ 

Parentheses are routinely suppressed because of the associative property of matrix multiplication. 


9. a. True, by definition of invertible. 
1 1 


c. False. If A = 


b. False. See Theorem 6(b). 
then ab - cd = 1-0^0, but Theorem 4 shows that this matrix is not invertible, 


0 0 
because ad - be = 0. 

d. True. This follows from Theorem 5, which also says that the solution of Ax = b is unique, for each b. 

e. True, by the box just before Example 6. 


10. a. False. The product matrix is invertible, but the product of inverses should be in the reverse order. 
See Theorem 6(b). 

b. True, by Theorem 6(a). c. True, by Theorem 4. 

d. True, by Theorem 7. e. False. The last part of Theorem 7 is misstated here. 


11. (The proof can be modeled after the proof of Theorem 5.) The n x p matrix B is given (but is arbitrary). 
Since A is invertible, the matrix A X B satisfies AX = B, because A(A~ X B) = A A~ X B = IB = B. To show this 
solution is unique, let X be any solution of AX = B. Then, left-multiplication of each side by A 1 shows 
that X must be A~ X B: 

A~ x (AX) = A~ X B, IX = A'B, and X = A~ x B. 


12. If you assign this exercise, consider giving the following Hint: Use elementary matrices and imitate the 
proof of Theorem 7. The solution in the Instructor’s Edition follows this hint. Here is another solution, 
based on the idea at the end of Section 2.2. 

Write B = [bi • • • bp] and X = [ui • • • u p ]. By definition of matrix multiplication, 

AX= [Aui ■ ■ ■ Au p \. Thus, the equation AX = B is equivalent to the p systems: 

Aui = b b ... Au p = b p 

Since A is the coefficient matrix in each system, these systems may be solved simultaneously, placing the 
augmented columns of these systems next to A to form [A bi • • • b P ] = [A B\. Since A is 
invertible, the solutions Uj, ..., Up are uniquely determined, and [A b] • • • b /; ] must row reduce to 
[I Ui • • • Up] = [I X], By Exercise 1 1 , X is the unique solution A l B of AX = B. 

13. Feft-multiply each side of the equation AB = AC by A 1 to obtain 

A X AB = A~ X AC, IB = IC, and B = C. 

This conclusion does not always follow when A is singular. Exercise 10 of Section 2. 1 provides a 
counterexample. 

14. Right-multiply each side of the equation (B - C)D = 0 by D l to obtain 

(B - QDD~ l = 0D~\ (B-C)I- 0. B-C=0, and B = C. 

15. The box following Theorem 6 suggests what the inverse of ABC should be, namely, C X B I A~ 1 . To verify 
that this is correct, compute: 

(ABC) C '/r’/T 1 =ABCC'B \r' = ABIB x A~ l = ABB 'a ' =AIA ] = AA~ X = I 
and 


CT x B l A~ x (ABC) = C~ l B~ l A~ x ABC = C X B X IBC = C x B l BC = C X IC = C~ X C = I 
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16. Let C = AB. Then CB 1 = ABB l , so CB 1 =AI = A. This shows that A is the product of invertible 
matrices and hence is invertible, by Theorem 6. 

Note: The Study Guide warns against using the formula (AB) 1 = B ] A 1 here, because this formula can be 
used only when both A and B are already known to be invertible. 

17. Right-multiply each side of AB = BC by B 1 : 

ABB 1 = BCB~\ AI = BCB~\ A = BCE 1 . 

18. Left-multiply each side of A= PBP 1 by P 

P l A = P~ { PBP~\ P rl A = IBP~\ P'A = BP' 1 
Then right-multiply each side of the result by P: 

P~ X AP = BP'P, P'AP = BI, P'AP = B 

19. Unlike Exercise 17, this exercise asks two things, “Does a solution exist and what is it?” First, find what 
the solution must be, if it exists. That is, suppose X satisfies the equation C~ \A + X)B~ 1 = /. Left-multiply 
each side by C, and then right-multiply each side by B: 

CCr\A + X)BT 1 = CI, I(A + X)B 1 = C, (A + X)B~'B = CB, (A+X)I=CB 
Expand the left side and then subtract A from both sides: 

AI + XI=CB , A+X=CB , X= CB - A 

If a solution exists, it must be CB - A. To show that CB - A really is a solution, substitute it for X: 
r\A + (CB - A)\B 1 = C l [CB]B 1 = ct'cbb ' =11 = I. 

Note: The Study Guide suggests that students ask their instructor about how many details to include in their 
proofs. After some practice with algebra, an expression such as CC~ 1 (A + X)B 1 could be simplified directly to 
(A + X)B 1 without first replacing CC~ l by I. However, you may wish this detail to be included in the 
homework for this section. 

20. a. Left-multiply both sides of (A - AX)' 1 = X ] B by Xto see that B is invertible because it is the product 

of invertible matrices. 

b. Invert both sides of the original equation and use Theorem 6 about the inverse of a product (which 
applies because JC 1 and B are invertible): 

a - ax = (x'By 1 = Br\xr x y 1 = b 'x 

Then A = AX + B~ 1 X= (A + B l )X. The product (A + ZT 1 )X is invertible because A is invertible. Since 
A is known to be invertible, so is the other factor, A + B~\ by Exercise 16 or by an argument similar 
to part (a). Finally, 

(A + B~YA = (A + B~Y(A +B~ l )X=X 

Note: This exercise is difficult. The algebra is not trivial, and at this point in the course, most students will 
not recognize the need to verify that a matrix is invertible. 

21. Suppose A is invertible. By Theorem 5, the equation Ax = 0 has only one solution, namely, the zero 
solution. This means that the columns of A are linearly independent, by a remark in Section 1.7. 

22. Suppose A is invertible. By Theorem 5, the equation Ax = b has a solution (in fact, a unique solution) for 
each b. By Theorem 4 in Section 1.4, the columns of A span R". 

23. Suppose A is n x« and the equation Ax = 0 has only the trivial solution. Then there are no free variables 
in this equation, and so A has n pivot columns. Since A is square and the n pivot positions must be in 
different rows, the pivots in an echelon form of A must be on the main diagonal. Hence A is row 
equivalent to the n y n identity matrix. 
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24. If the equation Ax = b has a solution for each b in R", then A has a pivot position in each row, by 

Theorem 4 in Section 1 .4. Since A is square, the pivots must be on the diagonal of A. It follows that A is 
row equivalent to By Theorem 7, A is invertible. 


25. Suppose A = 
solution Xi = 


a b 
c d 
' d 
-c 


and ad - be = 0. If a = b = 0, then examine 


'0 

0~ 



'o' 

c 

d 

_ X 2_ 


0 


This has the 


. This solution is nonzero, except when a = b = c = d. In that case, however, A is the 


zero matrix, and Ax - 0 for even’ vector x. Finally, if a and b are not both zero, set x 2 = 


-b 

a 


. Then 


Ax 2 = 


a b 

~-b 


—ab + ba 


"o' 

c d 

a 


-cb + da 


0 _ 


, because —cb + da = 0. Thus, x 2 is a nontrivial solution of Ax = 0. 


So, in all cases, the equation Ax = 0 has more than one solution. This is impossible when A is invertible 
(by Theorem 5), so A is not invertible. 


26. 


' d 

-b 

a b 


da -be 

0 

—c 

a 

c d 


0 

-cb + ad 


. Divide both sides by ad - be to get CA = I. 


a b 

" d 

-b 


ad -be 

0 

c d 

-c 

a 


0 

-cb + da 


Divide both sides by ad - be. The right side is I. The left side is AC, because 

= AC 


1 

a b 

' d -b 


a b 

1 

' d -b 

ad -be 

c d 

-c a 


c d 

ad -be 

—c a 


27. a. Interchange A and B in equation (1) after Example 6 in Section 2. 1 : row, (BA) = row, (By A. Then 
replace B by the identity matrix: row, (A ) = row, (IA) = row, (I)-A. 
b. Using part (a), when rows 1 and 2 of A are interchanged, write the result as 


row 2 (A) 


row 2 (b)'A 


row 2 (/) 

roWj(H) 

= 

row { (I)-A 

= 

row^/) 

row 3 (A) 


row 3 (I) -A 


row 3 (/) 


Here, E is obtained by interchanging rows 1 and 2 of I. The second equality in (*) is a consequence of 
the fact that row ,(EA) = row, (E)-A. 


c. Using part (a), when row 3 of A is multiplied by 5, write the result as 


row^H) 


row^/)-^ 


roW\(I) 

row 2 (A) 

= 

row 2 (S)-A 

= 

row 2 (I) 

5-row 3 (H) 


5 -row i,(I) -A 


5-row 3 (7) 


Here, E is obtained by multiplying row 3 of / by 5. 


28. When row 3 of A is replaced by row 3 (A) - 4-rowi (A), write the result as 


roWjCH) 


row ,(I)-A 

row 2 (A) 

= 

row 2 (I)'A 

row 3 (A) - 4 ■ roWj (A) 


row 3 (d) A - 4 -row { (I)-A 
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row^/)-^ row^/) 

= row 2 (/)-H = row 2 (I) A = EA 

_[ro w 3 (/) - 4 • row ,(/)]• A row 3 (/) - 4 • row! ( I ) 

Here, E is obtained by replacing row 3 (7) by row 3 (7) - 4 row!(7) . 



1 2 1/5 0 1 0 -7/5 2 . -7/5 2 

. A~ l = 

0 14/5-1 0 1 4/5 -1 4/5 -1 



1 

0 

-2 

1 

0 

0“ 


“1 

0 

-2 

1 

0 

0" 

II 

1 — 1 

-3 

1 

4 

0 

1 

0 

~ 

0 

1 

-2 

3 

1 

0 


2 

-3 

4 

0 

0 

1 


_0 

-3 

8 

-2 

0 

1 


“ 1 0 -2 1 0 0] [ 1 0 0 8 3 1“ 

~0 1-2 3 1 0 ~ 0 10 10 4 1 

00 273 1_||_0 02 731 

"1 008 3 1 1 [8 3 1 " 

~ 0 10 10 4 1 . A~ l = 10 4 1 

00 17/2 3/2 1 / 2 J [7/2 3/2 1/2 

"1-2 1 1 0 0] r 1 -2 1 10 0" 

32. [A /]= 4 -7 3 0 1 0 ~ 0 1-1-4 10 

-2 6 -4 0 0 1_| |_0 2 -2 2 0 1 

“1-2 1 1 0 0" 

~ 0 1-1-4 10 . The matrix A is not invertible. 

0 0 0 10 -2 1 

“1 0 0-0“ 

-110 0 

33. Let 5= 0 -1 1 , and for j = 1, ...,«, let a,, b ; , and e, denote the yth columns of A, B, 

0 0 ••• -1 1 

and /, respectively. Note that for/ = 1, . . ., n - 1, a, - a, , = e, (because a, and a /+[ have the same entries 
except for the yth row), b y = e ; - e,. , and a„ = b„ = e„. 

To show that AB = /, it suffices to show that Abj = e, for each /. For / = 1 , ...,/;- 1 , 

Abj = A(tj - e /+ i) = Atj - Ae j+1 = a j - a /+1 = e. 
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and Ab„ = Ae„ = a„ = e„. Next, observe that a,- = e y - + • • • + e„ for each j. Thus, 

Biij = B(Zj + • • • + e„) = by + • • • + b„ 

1 C ^-/+ 1 ) + (fiy- ] P/ 12) + ’ ' ’ + ( P n _ ] P« ) + Py 
This proves that BA = I. Combined with the first part, this proves that B = A~\ 

Note: Students who do this problem and then do the corresponding exercise in Section 2.4 will appreciate the 
Invertible Matrix Theorem, partitioned matrix notation, and the power of a proof by induction. 


34. Let 



“1 

0 

0 • 

0“ 


1 

0 

0 ••• 0 " 


1 

2 

0 

0 


-1/2 

1/2 

0 

A = 

1 

2 

3 

0 

, and B = 

0 

-1/3 

1/3 


1 

2 

3 • 

n 


0 

0 

— 1 In 1 In 


and for / = 1, . . ., n, let a,-, by, and ey denote the /th columns of A, B , and /, respectively. Note that for 


7 = 1, ay = /(ej 


1 


e„), b y = -py - — -py +1 , and b„ = -e„. 
7 7 + 1 n 


To show that AB = I, it suffices to show that A by = py for each j. For j = 1, . . ., n - 1 


Abj = A 


1 1 

-e. 

j J 7 + 1 


"j + 1 


1 

—a , -- 


1 


7 y 7 + 1 


* 7+1 


- (Py + ' ' ' + P„) - (Py+1 + ' ' ' + e„) - Py 

Also, Ab„ = A\ — p (I j = — a„ = p (I . Finally, for j= 1, ..., h, the sum by 
v n J n 

whose value is — e . Thus, 

7 


b„ is a “telescoping sum” 


Baj =j(Bej 


j'( b/ 


b«) 7 


f \ ' 
— p, 


= e ; 


V7 7 

which proves that BA = I. Combined with the first part, this proves that B = A 1 . 


Note: If you assign Exercise 34, you may wish to supply a hint using the notation from Exercise 33: Express 
each column of A in terms of the columns Pi, . . ., p„ of the identity matrix. Do the same for B. 


35. Row reduce [A e 3 ]: 


"-2 

-7 

-9 

0“ 


1 

3 

4 

f 


“1 

3 

4 

f 


“1 

3 

4 

f 

2 

5 

6 

0 

~ 

2 

5 

6 

0 

~ 

0 

-1 

-2 

-2 

~ 

0 

-1 

-2 

-2 

1 

3 

4 

1 


-2 

-7 

-9 

0 


0 

-1 

-1 

2 


0 

0 

1 

4 


"1 

3 

0 

-15" 


"1 

3 

0 

-15' 


"1 

0 

0 

3" 

0 

-1 

0 

6 

~ 

0 

1 

0 

-6 

~ 

0 

1 

0 

-6 

0 

0 

1 

4 


0 

0 

1 

4 


0 

0 

1 

4 


Answer: The third column of A 1 is 


3 

-6 

4 
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36. 


[M] Write B = [A F\, where F consists of the last two columns of A, and row reduce: 



'-25 

-9 

-27 

0 

0" 


"1 

0 

0 

3/2 

-9/2" 

B = 

546 

180 

537 

1 

0 

~ 

0 

1 

0 

-433/6 

439/2 


154 

50 

149 

0 

1 


0 

0 

1 

68/3 

-69 


The last two columns of A 1 are 


1.5000 

-72.1667 

22.6667 


-4.5000 

219.5000 

-69.0000 


37. There are many possibilities for C, but C 



1 -1 

1 0 


is the only one whose entries are 1,-1, and 0. 


With only three possibilities for each entry, the construction of C can be done by trial and error. This is 
probably faster than setting up a system of 4 equations in 6 u nk nowns. The fact that A cannot be 
invertible follows from Exercise 25 in Section 2.1, because H is not square. 


38. Write AD =A[ di d 2 ] = [/Id, Ad 2 ]. The structure of A shows that D 


1 0 
0 0 
0 0 
0 1 


[There are 25 possibilities for D if entries of D are allowed to be 1,-1, and 0.] There is no 4x2 matrix C 
such that CA = / 4 . If this were true, then C A x would equal x for all x in R 4 . This cannot happen because 
the columns of A are linearly dependent and so Ax Q for some nonzero vector x. For such an x, 

CAx = C( 0) = 0. An alternate justification would be to cite Exercise 23 or 25 in Section 2.1. 


39. 



".005 

.002 

.001" 

"30" 


'.27' 


y = Df= 

.002 

.004 

.002 

50 

= 

.30 

. The deflections are .27 in., .30 in., and .23 in. at points 1, 2, 


.001 

.002 

.005 

20 


.23_ 



and 3, respectively. 


40. [M] The stiffness matrix is D Use an “inverse” command to produce 


D~ l 


= 125 


2 

-1 

0 


-1 

3 

-1 


0 

-1 

2 


To find the forces (in pounds) required to produce a deflection of .04 cm at point 3, most students will 
use technology to solve Di= (0, 0, .04) and obtain (0, -5, 10). 

Here is another method, based on the idea suggested in Exercise 42. The first column of D 1 lists the 
forces required to produce a deflection of 1 in. at point 1 (with zero deflection at the other points). Since 
the transformation y i — > ZT 4 y is linear, the forces required to produce a deflection of .04 cm at point 3 is 
given by .04 times the third column of D~ l , namely (,04)(125) times (0, -1, 2), or (0, -5, 10) pounds. 


41. To determine the forces that produce a deflections of .08, .12, .16, and .12 cm at the four points on the 
beam, use technology to solve Df= y, where y = (.08, .12, .16, .12). The forces at the four points are 12, 
1.5, 21.5, and 12 newtons, respectively. 
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42. [M] To determine the forces that produce a deflection of .240 cm at the second point on the beam, use 
technology to solve Df = y, where y = (0, .24, 0, 0). The forces at the four points are -104, 167, -113, 
and 56.0 newtons, respectively (to three significant digits). These forces are .24 times the entries in the 

second column of D l . Reason : The transformation y i—> D ~ l y is linear, so the forces required to produce 
a deflection of .24 cm at the second point are .24 times the forces required to produce a deflection of 1 
cm at the second point. These forces are listed in the second column of D '. 

Another possible discussion: The solution of Dx = (0, 1, 0, 0) is the second column of D~ l . 

Multiply both sides of this equation by .24 to obtain D(.24x) = (0, .24, 0, 0). So .24x is the solution 
of Df = (0, .24, 0, 0). (The argument uses linearity, but students may not mention this.) 

Note: The Study Guide suggests using gauss, swap, bgauss, and scale to reduce [A 7], because 
1 prefer to postpone the use of ref (or rref) until later. If you wish to introduce ref now, see the 
Study Guide’s technology notes for Sections 2.8 or 4.3. (Recall that Sections 2.8 and 2.9 are only covered 
when an instructor plans to skip Chapter 4 and get quickly to eigenvalues.) 


2.3 SOLUTIONS 


Notes: This section ties together most of the concepts studied thus far. With strong encouragement from an 
instructor, most students can use this opportunity to review and reflect upon what they have learned, and form 
a solid foundation for future work. Students who fail to do this now usually struggle throughout the rest of the 
course. Section 2.3 can be used in at least three different ways. 

(1) Stop after Example 1 and assign exercises only from among the Practice Problems and Exercises 1 
to 28. I do this when teaching “Course 3” described in the text's “Notes to the Instructor. ” If you did not 
cover Theorem 12 in Section 1.9, omit statements (f) and (i) from the Invertible Matrix Theorem. 

(2) Include the subsection “Invertible Linear Transformations” in Section 2.3, if you covered Section 1.9. 
I do this when teaching “Course 1” because our mathematics and computer science majors take this class. 
Exercises 29-40 support this material. 

(3) Skip the linear transformation material here, but discusses the condition number and the Numerical 
Notes. Assign exercises from among 1-28 and 41-45, and perhaps add a computer project on the condition 
number. (See the projects on our web site.) I do this when teaching “Course 2” for our engineers. 

The abbreviation IMT (here and in the Study Guide) denotes the Invertible Matrix Theorem (Theorem 8). 


1. The columns of the matrix 


5 

-3 


7 

-6 


are not multiples, so they are linearly independent. By (e) in the 


IMT, the matrix is invertible. Also, the matrix is invertible by Theorem 4 in Section 2.2 because the 
determinant is nonzero. 


2 . 


The fact that the columns of 


-4 

6 


6 

-9 


are multiples is not so obvious. The fastest check in this case 


may be the determinant, which is easily seen to be zero. By Theorem 4 in Section 2.2, the matrix is 
not invertible. 


3. Row reduction to echelon form is trivial because there is really no need for arithmetic calculations: 


' 5 

0 

0 " 


"5 

0 

0 " 


"5 

0 

0 " 


-3 

-7 

0 

~ 

0 

-7 

0 

~ 

0 

-7 

0 

The 3x3 matrix has 3 pivot positions and hence is 

8 

5 

-1 


0 

5 

-1 


0 

0 

-1 



invertible, by (c) of the IMT. [Another explanation could be given using the transposed matrix. But see 
the note below that follows the solution of Exercise 14.] 



2.3 


Solutions 


97 


-7 0 4 

4. The matrix 3 0-1 obviously has linearly dependent columns (because one column is zero), and 

2 0 9 

so the matrix is not invertible (or singular) by (e) in the IMT. 

“o 3 -si r i o 2] r i o 2i r i o 2 

5. 1 0 2 - 0 3 -5 -0 3 -5 -0 3 -5 

-4 -9 l\ |_— 4 -9 7 J |_0 -9 I 5 J [0 0 0 

The matrix is not invertible because it is not row equivalent to the identity matrix. 

"1 -5 -4] [1 -5 -4] I" 1 -5 -4' 

6 . 0 3 4- 0 3 4-0 3 4 

-3 6 Oj |_0 -9 -12J [0 0 0 

The matrix is not invertible because it is not row equivalent to the identity matrix. 

'-1 -3 0 ll [-1 -3 0 ll [-1 -3 0 f 

3 58 -3 0 -4 80 0 -4 80 

7. - - 

-2 -6 32 0030 0030 

0-12 lj |_ 0 -1 2 lj |_ 0 0 0 1 

The 4x4 matrix has four pivot positions and so is invertible by (c) of the IMT. 

"1 3 7 4' 

0 5 9 6 

8. The 4x4 matrix q q 2 8 * S invertible because it has four pivot positions, by (c) of the IMT. 

0 0 0 10 

"4 0-7 -7] [-1 2 3 -ll [-1 2 3 -f 

-6 1 11 9 -6 1 11 9 0 -11 -7 15 

9. [M] 

7 -5 10 19 7 -5 10 19 0 9 31 12 

-1 2 3 -lj [ 4 0 -7 -7j [ 0 8 5 -11 

"-1 2 3 -ll [-1 2 3 -1 1 [-1 2 3 -1 

0 8 5 —11 0 8 5 —11 0 8 5 -11 

0 9 31 12 ~ 0 0 25.375 24.375 0 0 25.375 24.375 

0-11-7 15j [ 0 0 -.1250 -.1250 J [0 0 1 1 

'-1 2 3 -1 1 [-1 2 3 -f 

0 8 5 —11 0 8 5 —11 

0 0 1 1 ~ 0 0 1 1 

0 0 25.375 24.375 J L 0 0 0 -1 

The 4x4 matrix is invertible because it has four pivot positions, by (c) of the IMT. 
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"5 3 1 7 9l [5 3 1 7 9 

6 4 2 8 -8 0 .4 .8 -.4 -18.8 

10. [M] 7 5 3 10 9 ~ 0 .8 1.6 .2 -3.6 

9 6 4 -9 -5 0 .6 2.2 -21.6 -21.2 

8 5 2 11 4 J |_0 .2 .4 -.2 -10.4 

"5 3 1 7 9] [5 3 1 7 9" 

0 .4 .8 -.4 -18.8 0 .4 .8 -.4 -18.8 

- 0 0 0 1 34 - 0 0 1 -21 7 

0 0 1 -21 7 0 0 0 1 34 

0 0 0 0 -lj L° 0 0 0 

The 5x5 matrix is invertible because it has five pivot positions, by (c) of the 1MT. 

11. a. True, by the 1MT. If statement (d) of the 1MT is true, then so is statement (b). 

b. True. If statement (h) of the IMT is true, then so is statement (e). 

c. False. Statement (g) of the IMT is true only for invertible matrices. 

d. True, by the IMT. If the equation Ax - 0 has a nontrivial solution, then statement (d) of the IMT is 
false. In this case, all the lettered statements in the IMT are false, including statement (c), which 
means that A must have fewer than n pivot positions. 

e. True, by the IMT. If A r is not invertible, then statement (1 ) of the IMT is false, and hence statement 
(a) must also be false. 

12. a. True. If statement (k) of the IMT is true, then so is statement ( j). 

b. True. If statement (e) of the IMT is true, then so is statement (h). 

c. True. See the remark immediately following the proof of the IMT. 

d. False. The first part of the statement is not part (i) of the IMT. In fact, if A is any nxn matrix, the 
linear transformation x I— > Ax maps Pi" into ", yet not every such matrix has n pivot positions. 

e. True, by the IMT. If there is a b in " such that the equation Ax = b is inconsistent, then statement (g) 
of the IMT is false, and hence statement (f) is also false. That is, the transformation xh->Ax cannot 
be one-to-one. 

Note: The solutions below for Exercises 13-30 refer mostly to the IMT. In many cases, however, part or all 
of an acceptable solution could also be based on various results that were used to establish the IMT. 

13. If a square upper triangular n x n matrix has nonzero diagonal entries, then because it is already in echelon 
form, the matrix is row equivalent to /„ and hence is invertible, by the IMT. Conversely, if the matrix is 
invertible, it has n pivots on the diagonal and hence the diagonal entries are nonzero. 

14. If A is lower triangular with nonzero entries on the diagonal, then these n diagonal entries can be used as 
pivots to produce zeros below the diagonal. Thus A has n pivots and so is invertible, by the IMT. If one 
of the diagonal entries in A is zero, A will have fewer than n pivots and hence be singular. 

Notes: For Exercise 14, another correct analysis of the case when A has nonzero diagonal entries is to apply 
the IMT (or Exercise 13) to A r . Then use Theorem 6 in Section 2.2 to conclude that since A 1 is invertible so is 
its transpose, A. You might mention this idea in class, but I recommend that you not spend much time 
discussing A r and problems related to it, in order to keep from making this section too lengthy. (The transpose 
is treated infrequently in the text until Chapter 6.) 

If you do plan to ask a test question that involves A T and the IMT, then you should give the students some 
extra homework that develops skill using A r . For instance, in Exercise 14 replace “columns” by “rows.” 
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Also, you could ask students to explain why an n y n matrix with linearly independent columns must also have 
linearly independent rows. 

15. If A has two identical columns then its columns are linearly dependent. Part (e) of the IMT shows that 
A cannot be invertible. 

16. Part (h) of the IMT shows that a 5><5 matrix cannot be invertible when its columns do not span R 5 . 

17. If A is invertible, so is A~\ by Theorem 6 in Section 2.2. By (e) of the IMT applied to A ', the columns of 
A 1 are linearly independent. 

18. By (g) of the IMT, C is invertible. Hence, each equation Cx = v has a unique solution, by Theorem 5 in 
Section 2.2. This fact was pointed out in the paragraph following the proof of the IMT. 

19. By (e) of the IMT, D is invertible. Thus the equation Dx = b has a solution for each b in R 7 , by (g) of 
the IMT. Even better, the equation Dx = b has a unique solution for each b in R 7 , by Theorem 5 in 
Section 2.2. (See the paragraph following the proof of the IMT.) 

20. By the box following the IMT, E and F are invertible and are inverses. So FE = I = EF, and so E and F 
commute. 

21. The matrix G cannot be invertible, by Theorem 5 in Section 2.2 or by the box following the IMT. So (h) 
of the IMT is false and the columns of G do not span R". 

22. Statement (g) of the IMT is false for H, so statement (d) is false, too. That is, the equation Fix = 0 has a 
nontrivial solution. 

23. Statement (b) of the IMT is false for K, so statements (e) and (h) are also false. That is, the columns of K 
are linearly dependent and the columns do not span R". 

24. No conclusion about the columns of L may be drawn, because no information about L has been given. 

The equation Lx = 0 always has the trivial solution. 

25. Suppose that A is square and AB = I. Then A is invertible, by the (k) of the IMT. Left-multiplying each 
side of the equation AB = I by A~\ one has 

A~ l AB = A~ X I, IB = A~\ and B=A~\ 

By Theorem 6 in Section 2.2, the matrix B (which is A ') is invertible, and its inverse is (H -1 ) -1 , 
which is A. 

26. If the columns of A are linearly independent, then since A is square, A is invertible, by the IMT. So A 1 , 
which is the product of invertible matrices, is invertible. By the IMT, the columns of A 2 span R". 

27. Let Wbe the inverse of AB. Then ABW= I and A(BW) = I. Since A is square, A is invertible, by (k) of the 
IMT. 

Note: The Study Guide for Exercise 27 emphasizes here that the equation A{BW) = I, by itself, does not show 
that A is invertible. Students are referred to Exercise 38 in Section 2.2 for a counterexample. Although there is 
an overall assumption that matrices in this section are square, I insist that my students mention this fact when 
using the IMT. Even so, at the end of the course, I still sometimes find a student who thinks that an equation 
AB = I implies that A is invertible. 

28. Let W be the inverse of AB. Then WAB = I and (WA)B = I. By (j) of the IMT applied to B in place of A, 
the matrix B is invertible. 
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29. Since the transformation x i—> Ax is not one-to-one, statement (f) of the IMT is false. Then (i) is also 
false and the transformation x h > Ax does not map R" onto R". Also, A is not invertible, which implies 
that the transformation x f— > Ax is not invertible, by Theorem 9. 

30. Since the transformation xf->ix is one-to-one, statement (f) of the IMT is true. Then (i) is also true and 
the transformation x I —>Ax maps R" onto R”. Also, A is invertible, which implies that the transformation 
x i — > Ax is invertible, by Theorem 9. 

31. Since the equation Ax = b has a solution for each b, the matrix A has a pivot in each row (Theorem 4 in 
Section 1.4). Since A is square, A has a pivot in each column, and so there are no free variables in the 
equation Ax = b, which shows that the solution is unique. 

Note: The preceding argument shows that the (square) shape of A plays a crucial role. A less revealing proof 
is to use the “pivot in each row” and the IMT to conclude that A is invertible. Then Theorem 5 in Section 2.2 
shows that the solution of Ax - b is unique. 


32. If Ax - 0 has only the trivial solution, then A must have a pivot in each of its n columns. Since A is 
square (and this is the key point), there must be a pivot in each row of A. By Theorem 4 in Section 1 .4, 
the equation Ax = b has a solution for each b in R". 

Another argument: Statement (d) of the IMT is true, so A is invertible. By Theorem 5 in Section 2.2, 
the equation Ax = b has a (unique) solution for each b in R". 


33. 


r-5 9i 

(Solution in Study Guide ) The standard matrix of T is A = ^ which is invertible because 

det A 0. By Theorem 9, the transformation T is invertible and the standard matrix of T 1 is A '. From 


the formula for a 2x2 inverse, A 1 



T l (x l ,x 2 ) = 


7 9lf Xj 


4 5 x 


= (7xj + 9 x 2 , 4x l + 5x 2 ) 


34. The standard matrix of T is A = 


-5 7 


, which is invertible because det A = 2 ^ 0. By Theorem 9, 


-l 1 f7 8 

T is invertible, and T (x) = Bx, where B = A = — 

2 5 6 


. Thus 


T 1 (x 1 ,x 2 ) = - 


1 7 8 (7 .5 

— = — x, +4x 2 ,— x, + 5x 2 

2 5 6 x-, l 2 2 


35. (Solution in Study Guide ) To show that T is one-to-one, suppose that T( u ) = T(x) for some vectors u and 
v in R". Then S(T( u)) = S(T(x)), where S is the inverse of T. By Equation (1), u = S(T( u)) and S(T(y)) = v, 
so u = v. Thus T is one-to-one. To show that T is onto, suppose y represents an arbitrary vector in R" and 
define x = S( y). Then, using Equation (2), T(x) = T(S( y)) = y, which shows that T maps R" onto R". 

Second proof: By Theorem 9, the standard matrix A of Tis invertible. By the IMT, the columns of A are 
linearly independent and span R". By Theorem 12 in Section 1.9, T is one-to-one and maps R" onto R". 

36. If T maps R" onto R", then the columns of its standard matrix A span R", by Theorem 12 in Section 1.9. 
By the IMT, A is invertible. Hence, by Theorem 9 in Section 2.3, T is invertible, and A -1 is the standard 
matrix of 7 _ l . Since A~ l is also invertible, by the IMT, its columns are linearly independent and span R". 
Applying Theorem 12 in Section 1.9 to the transformation 7~', we conclude that T 1 is a one-to-one 
mapping of R" onto R". 
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37. Let A and B be the standard matrices of T and U, respectively. Then AB is the standard matrix of the 
mapping xh>T(U (x)) , because of the way matrix multiplication is defined (in Section 2. 1 ). By 
hypothesis, this mapping is the identity mapping, so AB = I. Since A and B are square, they are invertible, 
by the 1MT, and B = A l . Thus, BA = I. This means that the mapping xf->(7 (T(x)) is the identity 
mapping, i.e., U(T(x)) = x for all x in R". 

38. Let A be the standard matrix of T. By hypothesis, T is not a one-to-one mapping. So, by Theorem 12 in 
Section 1.9, the standard matrix A of T has linearly dependent columns. Since A is square, the columns 
of A do not span R". By Theorem 12, again, T cannot map R" onto R". 

39. Given any v in R", we may write v = 7'(x) for some x, because T is an onto mapping. Then, the assumed 
properties of S and U show that S(x) = S(T(x)) = x and U(v) = U(T(x)) = x. So S(v) and L'(v) are equal for 
each v. That is, S and U are the same function from R" into R". 

40. Given u, v in ", let x = S( u ) and y = S(x). Then T(x)=T(S( u)) = u and T( y) = 7'(S(v)) = v, by 
equation (2). Hence 

S(u + v) = S(T(x) + T(y)) 

= S(T(x + y)) Because T is linear 
= x + y By equation (1) 

= S(u) + S(y) 

So, S preserves sums. For any scalar r, 

S(ru) = S(rT(x)) = S(T(rx)) Because T is linear 
= r x By equation ( 1 ) 

= rS(u) 

So S preserves scalar multiples. Thus S ia a linear transformation. 

41. [M] a. The exact solution of (3) is X\ = 3.94 and x 2 = .49. The exact solution of (4) is Xi = 2.90 and 

x 2 = 2 . 00 . 

b. When the solution of (4) is used as an approximation for the solution in (3) , the error in using the 
value of 2.90 forxi is about 26%, and the error in using 2.0 forx 2 is about 308%. 

c. The condition number of the coefficient matrix is 3363. The percentage change in the solution from 
(3) to (4) is about 7700 times the percentage change in the right side of the equation. This is the same 
order of magnitude as the condition number. The condition number gives a rough measure of how 
sensitive the solution of Ax = b can be to changes in b. Further information about the condition 
number is given at the end of Chapter 6 and in Chapter 7. 

Note: See the Study Guide’s MATLAB box, or a technology appendix, for information on condition number. 
Only the TI-83+ and TI-89 lack a command for this. 

42. [M] MATLAB gives cond(H) = 23683, which is approximately 10 4 . If you make several trials with 
MATLAB, which records 16 digits accurately, you should find that x and Xi agree to at least 12 or 13 
significant digits. So about 4 significant digits are lost. Here is the result of one experiment. The vectors 
were all computed to the maximum 1 6 decimal places but are here displayed with only four decimal 
places: 



".9501 " 


"-3.8493" 


".9501" 

x = rand(4,l) = 

.21311 

, b = Ax = 

5.5795 

. The MATLAB solution is Xi = A h = 

.2311 

.6068 

20.7973 


.6068 


.4860 


.8467 


.4860 
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However, x - x, = 


12 decimal places. 


.0171 

.4858 

-.2360 

.2456 


10 12 . The computed solution Xj is accurate to about 


43. [M] MATLAB gives cond(T) = 68,622. Since this has magnitude between 10 4 and 1 0 5 , the estimated 
accuracy of a solution ofHx = b should be to about four or five decimal places less than the 16 decimal 
places that MATLAB usually computes accurately. That is, one should expect the solution to be accurate 
to only about 11 or 12 decimal places. Here is the result of one experiment. The vectors were all 
computed to the maximum 16 decimal places but are here displayed with only four decimal places: 


x = rand(5, 1 ) = 


“.2190“ 


“ 15.0821“ 


“.2190“ 

.0470 


.8165 


.0470 

.6789 

, b = Ax = 

19.0097 

. The MATLAB solution is X| = A h = 

.6789 

.6793 


-5.8188 


.6793 

.9347_ 


14.5557_ 


.9347_ 


.3165 


However, \\ = 


-.6743 


.3343 

.0158 


xlO 11 . The computed solution xi is accurate to about 1 1 decimal places. 


-.0005 


44 . [M] Solve Ax = (0, 0, 0, 0, 1). MATLAB shows that cond(H) ~ 4.8 x 10 5 . Since MATLAB computes 
numbers accurately to 16 decimal places, the entries in the computed value of x should be accurate to at 
least 1 1 digits. The exact solution is (630, -12600, 56700, -88200, 44100). 

45 . [M] Some versions of MATLAB issue a warning when asked to invert a Hilbert matrix of order 12 or 
larger using floating-point arithmetic. The product AH 1 should have several off-diagonal entries that are 
far from being zero. If not, try a larger matrix. 


Note: All matrix programs supported by the Study Guide have data for Exercise 45, but only MATLAB and 
Maple have a single command to create a Hilbert matrix. The HP-48G data for Exercise 45 contain a program 
that can be edited to create other Hilbert matrices. 


Notes: The Study Guide for Section 2.3 organizes the statements of the Invertible Matrix Theorem in a table 
that imbeds these ideas in a broader discussion of rectangular matrices. The statements are arranged in three 
columns: statements that are logically equivalent for any m *n matrix and are related to existence concepts, 
those that are equivalent only for any n x n matrix, and those that are equivalent for any n xp matrix and are 
related to uniqueness concepts. Four statements are included that are not in the text’s official list of 
statements, to give more symmetry to the three columns. You may or may not wish to comment on them. 

I believe that students cannot fully understand the concepts in the IMT if they do not know the correct 
wording of each statement. (Of course, this knowledge is not sufficient for understanding.) The Study 
Guide’s Section 2.3 has an example of the type of question I often put on an exam at this point in the course. 
The section concludes with a discussion of reviewing and reflecting, as important steps to a mastery of linear 
algebra. 
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2.4 SOLUTIONS 

Notes: Partitioned matrices arise in theoretical discussions in essentially every field that makes use of 
matrices. The Study Guide mentions some examples (with references). 

Every student should be exposed to some of the ideas in this section. If time is short, you might omit 
Example 4 and Theorem 10, and replace Example 5 by a problem similar to one in Exercises 1-10. (A sample 
replacement is given at the end of these solutions.) Then select homework from Exercises 1-13, 15, and 21- 
24. 

The exercises just mentioned provide a good environment for practicing matrix manipulation. Also, 
students will be reminded that an equation of the form AB = I does not by itself make A or B invertible. (The 
matrices must be square and the IMT is required.) 

1. Apply the row-column rule as if the matrix entries were numbers, but for each product always write the 
entry of the left block-matrix on the left. 


~ I 

O' 

' A 

B 


IA + 0C 

IB + 0D~ 


A 

B 

E 

I 

C 

D 


EA + IC 

EB + ID 


EA + C 

EB + D 


2 . Apply the row-column rule as if the matrix entries were numbers, but for each product always write the 
entry of the left block-matrix on the left. 


E 

0 " 

' A 

B 


~ EA + 0C 

EB + 0D~ 


EA 

EB 

0 

F 

C 

D 


0 A + FC 

0 B + FD 


EC 

FD 


3. Apply the row-column rule as if the matrix entries were numbers, but for each product always write the 
entry of the left block-matrix on the left. 


0 

I 

'W 

X ' 


"0 W + IY 

OX + IZ' 


" Y 

z~ 

/ 

0 

Y 

z 


IW + 0Y 

IX + 0Z 


W 

X 


4 . Apply the row-column rule as if the matrix entries were numbers, but for each product always write the 
entry of the left block-matrix on the left. 


' / 

0 " 

' A 

B 


' IA + 0C 

IB + 0D 


A 

B 

-X 

I 

C 

D 


-XA + IC 

-XB + ID 


- XA + C 

- XB + D 


5. Compute the left side of the equation: 


' A 

B~ 

' I 

0 " 


AI + BX 

ao+by' 

C 

0 

X 

Y 


Cl + OX 

C0 + 0Y_ 


Set this equal to the right side of the equation: 


A + BX 

BY' 


"0 

I 

A + BX = 0 

so that 

1 — < 

11 

C 

0 


Z 

0 

C = Z 

0 = 0 


Since the (2, 1) blocks are equal, Z=C. Since the (1,2) blocks are equal, BY = I. To proceed further, 
assume that B and Y are square. Then the equation BY =/ implies that B is invertible, by the IMT, and 
Y = B l . (See the boxed remark that follows the IMT.) Finally, from the equality of the (1, 1) blocks, 

BX= -A, B i BX = B~\-A), and X=-B a A. 

The order of the factors for X is crucial. 

Note: For simplicity, statements (j) and (k) in the Invertible Matrix Theorem involve square matrices 
C and D. Actually, if A is n y n and if C is any matrix such that AC is the n y n identity matrix, then C must be 
n x/ 7 , too. (For AC to be defined, C must have n rows, and the equation AC = / implies that C has n columns.) 
Similarly, DA = I implies that D is 77 x 77 . Rather than discuss this in class, I expect that in Exercises 5-8, when 
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students see an equation such as BY = I, they will decide that both B and Y should be square in order to use 
the IMT. 

6. Compute the left side of the equation: 


~x 

O' 

"Z 

O' 


' XA + 0B 

X0 + 0 C 


XA 

0 " 

_Y 

Z 

B 

C 


YA + ZB 

T0 + ZC 


YA + ZB 

ZC 


Set this equal to the right side of the equation: 


XA 

0 ' 


7 

o' 

XA = I 

so that 

0 = 0 

YA + ZB 

ZC 


0 

/ 

YA + ZB = 0 

ZC = I 


To use the equality of the (1,1) blocks, assume that A and X are square. By the IMT, the equation 
XA =1 implies that A is invertible and X=A (See the boxed remark that follows the IMT.) Similarly, 
if C and Z are assumed to be square, then the equation ZC = / implies that C is invertible, by the IMT, 
and Z = C~ x . Finally, use the (2, 1) blocks and right-multiplication by A~ x : 

YA = -ZB- -C'B, YAA 1 = (~C~ 1 B)A~ X , and Y=-C'BA' 

The order of the factors for Y is crucial. 

7. Compute the left side of the equation: 





~ A 

z" 




~x 

0 

O' 

0 

0 



'X4 + 0 + 0R 

XZ + 0 + 01 

Y 

0 

/ 




YA + 0 + IB 

YZ + 0 + II 




B 

I 





Set this equal to the right side of the equation: 


XA 

XZ 


7 

O' 

XA = I 

so that 

O 

II 

YA + B 

YZ + I 


0 

/ 

YA + B = 0 

YZ + I = I 


To use the equality of the (1,1) blocks, assume that A and X are square. By the IMT, the equation XA =/ 
implies that A is invertible and X=A (See the boxed remark that follows the IMT) Also, X is 
invertible. Since XZ = 0, XT 1 XZ = X~ x 0 = 0, so Z must be 0. Finally, from the equality of the (2, 1) 
blocks, YA = -B. Right-multiplication by A~ x shows that YAA 1 = -BA' 1 and Y = -BA ~ x . The order of the 
factors for Y is crucial. 

8. Compute the left side of the equation: 


~A 

B 

'X 

Y 

z 


' AX + B0 

AY + B0 

AZ + Bf 

0 

I 

0 

0 

I 


OX + 10 

0Y + /0 

0Z + II 


Set this equal to the right side of the equation: 


' AX 

AY 

AZ + B~ 


7 

0 

0" 

0 

0 

I 


0 

0 

/ 


To use the equality of the (1,1) blocks, assume thatZ and X are square. By the IMT, the equation XA =1 
implies that A is invertible and X = A 1 . (See the boxed remark that follows the IMT. Since AY = 0, from 
the equality of the (1,2) blocks, left-multiplication by A 1 gives A~ X AY= A~ x 0 = 0, so Y= 0. Finally, from 
the (1,3) blocks, AZ = —B. Left-multiplication by A~ x gives A X AZ = A X (-B), and Z = —A X B. The order 
of the factors for Z is crucial. 

Note: The Study Guide tells students, “Problems such as 5-10 make good exam questions. Remember to 
mention the IMT when appropriate, and remember that matrix multiplication is generally not commutative.” 
When a problem statement includes a condition that a matrix is square, I expect my students to mention this 
fact when they apply the IMT. 
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9. Compute the left side of the equation: 


7 

0 

0" 

'A i 

Ai 


IA\ j + 0^21 “I" 0^31 

IA\2 + 0^22 T 0^32 

X 

I 

0 

Ai 

A 22 

= 

XA^ i + IA 2i + Ozl^i 

XA l2 + IA 2 2 + 0Z 32 

Y 

0 

I 

_Ai 

Ai_ 


i + 0z^2l -^3 1 

YA^i -l - OA 22 + JA^ 


Set this equal to the right side of the equation: 


A 1 

A 2 


~B n 

B\2 

■^Ai + At 

XA U + A 2 2 

= 

0 

B 22 

_ ^Ai + Ai 

YA 2 + A 2 _ 


0 

Bt,2_ 


Ai ~ B n A 2 — Bn 

so that XA U + A 2l =0 XA n + A 22 = B 22 

YA[ i + Ai YA l2 + A 22 = B 2 2 


Since the (2,1) blocks are equal, XA n + A 2l = 0 and XA n = —A 2l . Since A u is invertible, right 
multiplication by A u ] gives X = -A 2l A n ' . Likewise since the (3,1) blocks are equal, 

YA\ + Ai = 0 and YA n = —A 31 . Since A n is invertible, right multiplication by A n l gives Y = -A 3l A n l . 
Finally, from the (2,2) entries, XA n + A 22 = B 22 . Since X = -A 21 A 1 ~/,B 2 2 = ~A 2l A n , A t2 + A 22 . 

10. Since the two matrices are inverses, 


" I 

0 

0 " 

~ T 

0 

0 " 


7 

0 

0 " 

c 

1 

0 

Z 

I 

0 

= 

0 

I 

0 

A 

B 

I 

X 

Y 

I 


0 

0 

I 


Compute the left side of the equation: 


7 

0 

0" 

7 

0 

0" 


~ II + 0Z + 0X 

IQ + 01 + 07 

70 + 00 + 0/" 

c 

/ 

0 

Z 

I 

0 

= 

CI + IZ + 0X 

C0 + II + 0Y 

C0 + /0 + 07 

4 

B 

/ 

X 

Y 

I 


AI + BZ + IX 

A0 + BI + IY 

A0 + B0 + II 


Set this equal to the right side of the equation: 


I 

0 

O' 


7 

0 

0" 

C + Z 

/ 

0 

= 

0 

1 

0 

A + BZ + X 

B + Y 

I 


0 

0 

I 


1 = 1 


0 = 

0 

0 = 

so that 

C + Z = 0 


1 = 

I 

0 = 


A + BZ + X = 0 B + Y = 0 1 = 1 

Since the (2,1) blocks are equal, C + Z = 0 and Z = -C . Likewise since the (3, 2) blocks are equal, 
B + Y = 0 and Y = -B. Finally, from the (3,1) entries, A + BZ + X = 0 and X = - A - BZ. 

Since Z = -C, X = -A- B(-C ) = -A + BC . 

11. a. True. See the subsection Addition and Scalar Multiplication. 
b. False. See the paragraph before Example 3. 

12. a. True. See the paragraph before Example 4. 
b. False. See the paragraph before Example 3. 
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13 . You are asked to establish an if and only if statement. First, supose that A is invertible, 


and let A 1 = 


D E 
F G 


Then 


~B 

0" 

~D 

E~ 


BD 

BE' 


7 

O' 

0 

c 

_F 

G 


CF 

CG 


0 

I 


Since B is square, the equation BD = I implies that B is invertible, by the 1MT. Similarly, CG = I implies 
that C is invertible. Also, the equation BE = 0 imples that E = B l 0 = 0. Similarly F= 0. Thus 


~B 

0" 

-1 

D 

E 


V' 

0 ’ 

0 

C 


E 

G 


0 

c- 1 


This proves that A is invertible only if B and C are invertible. For the “if” part of the statement, suppose 
that B and C are invertible. Then (*) provides a likely candidate for A~ l which can be used to show that 
A is invertible. Compute: 


B 

0 " 

"5 1 

0 " 


1 

& 

to 

1 

0 


7 

0 " 

0 

c 

0 

c~\ 


0 

cc~‘ 


0 

I 


Since A is square, this calculation and the IMT imply that A is invertible. (Don’t forget this final 
sentence. Without it, the argument is incomplete.) Instead of that sentence, you could add the equation: 


B~ l 

0 " 

~B 

0“ 


B~ l B 

0 


7 

0" 

0 

C“‘ 

0 

c 


0 

c~ l c 


0 

I 


14 . You are asked to establish an if and only if statement. First suppose that A is invertible. Example 5 shows 
that An and A 22 are invertible. This proves that A is invertible only if A u A 22 are invertible. For the // part 
of this statement, suppose that A u and A 22 are invertible. Then the formula in Example 5 provides a likely 
candidate for A~ l which can be used to show that A is invertible . Compute: 



A 2 

r a- 1 

— A~ x A A~ l 
/± \\ /± \2 /± 22 


^ 11 ^ 11 + A l2 0 

■^11 ( ^ 11 12 ^ 22 4" A l2 a 22 

0 

a 22 

0 

A~ x 

^ 22 J 


0 A +A ?? 0 

L n 22 

0(—A n)A 12 A 22 + A 22 A 22 


( 7 l A 11)^12 A 22 T A \ 2 A 
/ 


I 

A 12 ^ 22“*" ^ 12 ^ 22 


1 

1 

0 

0 

1 


0 

n 


Since A is square, this calculation and the IMT imply that A is invertible. 


15 . Compute the right side of the equation: 



0" 

~Ai 

0 " 

7 

Y~ 


" A n 

0" 

7 

Y~ 


" Ai 

1 

"7 

X 

/ 

0 

s 

0 

I 


_XA U 

s 

0 

I 


XA U 

XA n Y+S 


Set this equal to the left side of the equation: 


A u 

A n Y 


~A n 

A 12 

so that ** 11 

ll 

7. 

"7 

A 12 

XA 11 

XA n Y + S 


_^21 

A 22 _ 

XA U = A 21 

XA U Y+S= 

^22 


Since the (1, 2) blocks are equal, A U Y= A u . Since A 1 1 is invertible, left multiplication by A , gives 
Y= A^l A u . Likewise since the (2,1) blocks are equal, XA U =A 2 \. Since A 1 1 is invertible, right 
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multiplication by A n l gives that X = A 21 A n 1 . One can check that the matrix S as given in the exercise 
satisfies the equation XA n Y + S = A 22 with the calculated values of X and Y given above. 


16. Suppose that A and A u are invertible. First note that 


~ 1 

0 " 

“ / 

0 " 


7 

0 " 

_x 

I 

-X 

/ 


0 

I 


and 


7 

Y 

7 

-Y~ 


0 

I 

0 

I 




" / 0 " 


7 Y 

Since the matrices 

X / 

and 

0 / 


are square, they are both invertible by the IMT. Equation (7) may be left multipled by 


I 

X 


-i-i 


and right multipled by 


-i-i 


to find 


A i o 

0 5 


I 

X 





Thus by Theorem 6, the matrix 


Ai 

o 


is invertible as the product of invertible matrices. Finally, 


Exercise 13 above may be used to show that S is invertible. 


17. The colu mn -row expansions of G* and G*+* are: 

G k =X k X T k 

= colj (X* ) rowj (X * r ) + ... ■ + col*. (X k ) row* (X[ ) 
and 

Gk+i =x k A 

= col! (X k+l ) row , ( X* r + , ) + ■■■+ col * (X k+] ) row * (X[ +1 ) + col* +1 (X k+] ) row k+] (X T k+] ) 

= col! ( X k )row,(X[) + ...+ col* (X*) row* (X[ ) + col* +1 (X* +1 ) row* +1 (Xj ) 

= G k + col* +1 (X* +1 ) row* +1 (X[ ) 

since the first k columns ofX* +1 are identical to the first k columns ofX*. Thus to update G* to produce 
G*+i, the number col*+i (X* +1 ) row *.- 1 (X* ) should be added to G*. 


18. Since W = [X x 0 , 


W T W = 

V" 

T 

ii 

o 


L x o J 

1 1 


By applying the formula for S' from Exercise 15, S may be computed: 
S = x T 0 x 0 -x T 0 X(X T X)- l X T x 0 

= x T 0 (i m -x(x T xy 1 x T )x 0 

= Xo Afx 0 
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19. The matrix equation (8) in the text is equivalent to 

(A - sl n )x + Bu — 0 and Cx + u = y 

Rewrite the first equation as (A - sl n )x = -Bu. When A - sl n is invertible, 
x = (A- sI n y l (-Bu) = -(A - si,,)-' Bu 
Substitute this formula for x into the second equation above: 

C (-(A - sl n ) _1 Ru) + u = y , so that u - C(A - sl n ) _1 Bu = y 

Thus y = (I m - C (A - si n )~ l B)u. If W(s) = I m -C(A- sl n )~ l B, then y = fV(s)u. The matrix JT(s) is the 
Schur complement of the matrix A - sl n in the system matrix in equation (8) 

20. The matrix in question is 

A — BC — sl n B~ 

- C J ,n_ 

By applying the formula for S from Exercise 15, S may be computed: 

S = I m ~ (~C)(A - BC - sl m )~ l B 
= I m +C(A-BC-sI m y l B 


1 

0 " 


"1 + 0 0 + 0 “ 


“1 

0 " 

3 

-1 


3-3 0 + (- l ) 2 _ 


0 

1 


A 0] 

r a o“ 


~ A 2 +0 

0 + 0 


1 

o 

i 

1 — < 

i 

1 — < 
i 


A- A 

0 + (-A) 2 _ 


1 

o 

1 


22. Let C be any nonzero 2x3 matrix. Define A = 


h 

C 


0 

~^2 


. Then 


I 3 0 “ 


I 3 + 0 

0 + 0 



0" 

n 

i 

to 

1 


C/ 3 -/ 2 C 

0 + (-/ 2 ) 2 . 


0 

1 2 _ 


23. The product of two lxl “lower triangular” matrices is “lower triangular.” Suppose that for n = k, the 
product of two k x k lower triangular matrices is lower triangular, and consider any {k+ \ ) x (£+1) matrices 
A i and B\. Partition these matrices as 


A = 


a 

v 


O' 

A 


B { = 


b 

w 


0 r 

B 


where A and B are kxk matrices, v and w are in R 7 , and a and b are scalars. Since A \ and B\ are lower 
triangular, so are A and B. Then 


~a 0 r " 

’ b 

o r 


ab + 0 7 w 

n0 r + 0 r R 


ab 

0 r " 

v A 

w 

B 


xb + Aw 

v0 r + AB 


b\ + Aw 

AB 


Since A and B are kxk, AB is lower triangular. The form of d \B\ shows that it, too, is lower triangular. 
Thus the statement about lower triangular matrices is true for n = k +1 if it is true for n = k. By the 
principle of induction, the statement is true for all n > 1. 
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Note: Exercise 23 is good for mathematics and computer science students. The solution of Exercise 23 in the 
Study Guide shows students how to use the principle of induction. The Study Guide also has an appendix on 
“The Principle of Induction,” at the end of Section 2.4. The text presents more applications of induction in 
Section 3.2 and in the Supplementary Exercises for Chapter 3. 



“1 

0 

0 •• 

• 0“ 


1 

0 

0 

... 0 " 


1 

1 

0 

0 


-1 

1 

0 

0 

24. Let A n = 

1 

1 

1 

0 

, 4 = 

0 

-1 

1 

0 


1 

1 

1 •• 

• 1 


0 



-1 1 


By direct computation A 2 B 2 = h- Assume that for n = k, the matrix A k B k is I k , and write 


4+ 1 - 


o' 

A, 


and B m = 


1 


0 r 

B, 


where v and w are in R , v 


4+A+i - 


o' 

A 


’ r =[l 1 


■ 1], and w T = [-1 0 • • 

■ 0]. Then 

"l o r ~ 


"l + 0 r w 0 r +0 T B k ~ 


"l 0 r l 

w B k 


y + A k w v() 7 + A k B k 


1 

1 — i 

o 

1 


= 1 


k + 1 


The (2,l)-entry is 0 because v equals the first column of A k ., and A k y\ is -1 times the first column of A k . 
By the principle of induction, A n B n = /„ for all n> 2. Since A„ and B„ are square, the IMT shows that 
these matrices are invertible, and B = A~ l . 


Note: An induction proof can also be given using partitions with the form shown below. The details are 
slightly more complicated. 



"4 

0 " 


" B k 

0 " 

4-u _ 

T 

l 

and B kn = 

T 

l 


y 


W 


4+A+i - 


4 

0" 

I 

0 


4A+0w r 

A k 0 + 0 


1 

0" 

v r 

1 

T 

W 

l 


\ 7 B k + w r 

v r 0 + l 


o' 

1 


= /, 


k + 1 


The (2, l)-entry is 0 r because v r times a column of B k equals the sum of the entries in the column, and all 
of such sums are zero except the last, which is 1. So \ T B k is the negative of w 7 . By the principle of 
induction, A„B n = /„ for all n > 2. Since A„ and B„ are square, the IMT shows that these matrices are 
invertible, and B n = A~\ 


25. First, visualize a partition of A as a 2x2 block-diagonal matrix, as below, and then visualize the 
(2,2)-block itself as a block-diagonal matrix. That is, 


1 

2 

0 

0 

0 

3 

5 

0 

0 

0 

(T 

0 

2 

0 

~~0 

0 

0 

0 

7 

8 

0 

0 

0 

5 

6 


4i 

0 

0 

A 22 


2 

0 

0 

(T 

7 

~~ 8 

0 

5 

6 


2 0 
0 B 


, where A 22 = 
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Observe that B is invertible and B" 1 
invertible, and 


3 


-2.5 


-4 

3.5 


. By Exercise 13, the block diagonal matrix A 2 2 is 


A 22 - 1 


.5 

0 


3 

-4 

0 

-2.5 

3.5 


.5 

0 

0 


0 

3 

-2.5 


0 

-4 

3.5 


Next, observe that An is also invertible, with inverse 


. By Exercise 13, A itself is invertible, 


and its inverse is block diagonal: 


A~ l 


Ay l 1 0 

0 A~_l 


-5 2 

3 -1 

0 


.5 

0 

0 

0 

0 

3 

-4 


0 

-2.5 

3.5 


-5 2 0 0 0 

3-10 0 0 

0 0 .5 0 0 

0 0 0 3 -4 

0 0 0 -2.5 3.5 


26. [M] This exercise and the next, which involve large matrices, are more appropriate for MATLAB, 
Maple, and Mathematica, than for the graphic calculators, 
a. Display the submatrix of A obtained from rows 15 to 20 and columns 5 to 10. 

MATLAB: A (15: 20, 5:10) 


Maple: submatrix (A, 15.. 20, 5.. 10) 

Mathematica: Take [ A, {15, 20}, {5,10} ] 

b. Insert a 5x 10 matrix B into rows 10 to 14 and columns 20 to 29 of matrix A: 


MATLAB: 

Maple: 

Mathematica: 


c. To create B = 


A ( 10 : 14 , 20:29) = B ; 
copyinto(B, A, 10, 20): 
For [ i=10, i<=14, i++. 
For [ j=20, j<=29, j++, 
A [ [ i , j ]] = B [ [ i - 9 
A 0 ~ 


The semicolon suppresses output display. 
The colon suppresses output display. 


0 A 1 


j-19 ] ] ] ] ; 

with MATLAB, build B out of four blocks: 


Colon suppresses output. 


B = [A zeros (30 , 20) ; zeros(20,30) A']; 

Another method: first enter B = A ; and then enlarge B with the command 

B (21 : 50 , 31:50) = A' ; 

This places A r in the (2, 2) block of the larger B and fills in the (1,2) and (2, 1) blocks with zeros, 
for Maple: 

B := matrix (50 , 50 , 0) : 
copyinto(A, B, 1, 1): 
copyinto ( transpose (A) , B, 21, 31): 

Lor Mathematica: 

B = BlockMatrix [ {{A, ZeroMatrix [30, 20] } , ZeroMatrix [20, 30] , 
Transpose [A] }} ] 
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27. a. [M] Construct A from four blocks, say Cu, C n, C 21 , and C 22 , for example with Cn a 30x30 matrix 
and C 22 a 20x20 matrix. 

MATLAB: Cll = A (1:30, 1:30) + B(l:30, 1:30) 

C12 = A ( 1 : 3 0 , 31:50) + B(l:30, 31:50) 

C21 = A ( 31 : 5 0 , 1:30)+ B(31:50, 1:30) 

C22 = A (31 : 50 , 31:50) + B(31:50, 31:50) 

C = [Cll C12 ; C21 C22] 

The commands in Maple and Mathematica are analogous, but with different syntax. The first 
commands are: 

Maple: Cll := submatrix(A, 1..30, 1..30) + submatrix(B, 1..30, 1..30) 

Mathematica: cll := Take [ A, (l,30), {1,30} ] + Take[B, (l,30), {1,30} ] 

b. The algebra needed comes from block matrix multiplication: 


~Ai 

J ^ 

to 

1 


B n 


A n B n + A n B 2l 

A1A2 + 2 B22 

_Ai 

1 

CN 

- ^ 

1 

^22 _ 


_A n B n + A 22 B 2l 

A 2 l B l2 + A 22 B 22 ~ 


Partition both A and B, for example with 30x30 (1, 1) blocks and 20x20 (2, 2) blocks. The four 
necessary submatrix computations use syntax analogous to that shown for (a). 


c. The algebra needed comes from the block matrix equation 


1 

1 

O 

1 


1 

1 

1 

1 

CN 

1 

H 

to 


_^2_ 


, where Xi and bi 


are in R 30 and x 2 and b 2 are in R 20 . Then A\ 1 X 1 = b 1 , which can be solved to produce xi. Once Xi is 
found, rewrite the equation A 2 i\\ + A 22X2 = b 2 as A 22 x 2 = c, where c = b 2 - A 2 \X h and solve A 22 x 2 = c 
for x 2 . 


Notes: The following may be used in place of Example 5: 


Example 5 : Use equation (*) to find formulas for A, Y, and Z in terms of A, B , and C. Mention any 
assumptions you make in order to produce the formulas. 


'A 

0" 

“ I 

0" 


" I 

0" 

Y 

z 

A 

B 


C 

/ 


Solution: 


This matrix equation provides four equations that can be used to find A, Y, and Z: 
X+0 = 1, 0 = 0 


YI + ZA = C, Y0 + ZB = I (Note the order of the factors.) 

The first equation says that A = I. To solve the fourth equation, ZB = I, assume that B and Z are square. 

In this case, the equation ZB = I implies that B and Z are invertible, by the IMT. (Actually, it suffices to 
assume either that B is square or that Z is square.) Then, right-multiply each side of ZB = I to get 
ZBB 1 = IB 1 and Z = B \ Finally, the third equation is Y + ZA = C. So, Y + B ~ l A = C, and Y= C - B l A. 

The following counterexample shows that Z need not be square for the equation (*) above to be true. 


1 

0 

0 

0 

0 

0 

1 

0 

0 

0 

1 

2 

1 

3 

1 

3 

4 

1 

0 

-1 


1 

0 

0 

0 

0 

1 

0 

0 

1 

1 

2 

5 

1 

1 

-1 

-3 

1 

-1 

2 

4 


1 

0 

0 

0 

0 

1 

0 

0 

6 

5 

1 

0 

3 

6 

0 

1 
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Note that Z is not determined by A, B, and C, when B is not square. For instance, another Z that works in 


this counterexample is Z = 


5 

-2 


0 

0 


2.5 SOLUTIONS 


Notes: Modem algorithms in numerical linear algebra are often described using matrix factorizations. For 
practical work, this section is more important than Sections 4.7 and 5.4, even though matrix factorizations are 
explained nicely in terms of change of bases. Computational exercises in this section emphasize the use of the 
LU factorization to solve linear systems. The LU factorization is performed using the algorithm explained in 
the paragraphs before Example 2, and performed in Example 2. The text discusses how to build L when no 
interchanges are needed to reduce the given matrix to U. An appendix in the Study Guide discusses how to 
build L in permuted unit lower triangular form when row interchanges are needed. Other factorizations are 
introduced in Exercises 22-26. 



1 

0 

0 " 


"3 

-7 

-2 


'-7' 

1. L = 

-1 

1 

0 

,U = 

0 

-2 

-1 

,b = 

5 


2 

-5 

1 


0 

0 

-1 


2 


. First, solve Ly = b. 



1 

0 

0 

-7' 


"1 

0 

0 

-7' 

[L b] = 

-1 

1 

0 

5 

~ 

0 

1 

0 

-2 


2 

-5 

1 

2 


0 

-5 

1 

16 


The only arithmetic is in column 4 


"1 

0 

0 

-7' 


~-7~ 

0 

1 

0 

-2 

, soy = 

-2 

0 

0 

1 

6 


6 


Next, solve Ux = y, using back-substitution (with matrix notation). 



“3 

-7 

-2 

-7' 


“3 

-7 

-2 

-7" 


“3 

-7 

0 

-19“ 

[U y] = 

0 

-2 

-1 

-2 

~ 

0 

-2 

-1 

-2 


~ 

0 

-2 

0 

-8 


0 

0 

-1 

6 



0 

0 

1 

-6 



0 

0 

1 

-6 


"3 

-7 

0 

-19“ 


"3 

0 

0 

9“ 


- 

1 

0 

0 

3“ 


~ 

0 

1 

0 

4 

~ 

0 

1 

0 

4 

~ 


0 

1 

0 

4 



0 

0 

1 

-6 


0 

0 

1 

-6 



0 

0 

1 

-6 



So x = (3, 4, -6). 

To confirm this result, row reduce the matrix [A b]: 


“ 3 

-7 

-2 

-7" 


“3 

-7 

-2 

-7" 


“3 

-7 

-2 

-7“ 

-3 

5 

1 

5 

~ 

0 

-2 

-1 

-2 

~ 

0 

-2 

-1 

-2 

6 

-4 

0 

2 


0 

10 

4 

16 


0 

0 

-1 

6 


From this point the row reduction follows that of [U y] above, yielding the same result. 
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Next solve Ux = y, using back-substitution (with matrix notation): 

~4 3 -5 2] [4 3 -5 2] [4 3 0 7' 

[U y]= 0 -2 2 -2 ~ 0 -2 2 -2 - 0 -2 0 -4 

0 0 2 2J |_0 0 1 lj |_0 0 1 1 

'4 30 7] [400 1] [100 1/4" 

-0 1 02-0 1 02-0 10 2 , 

0 0 1 lj |_0 0 1 lj |_o 0 1 1 

so x = (1/4,2, 1). To confirm this result, row reduce the matrix [A b]: 

" 4 3 -5 2] [4 3 -5 2" 

[A b]= -4 -5 7 -4 - 0 -2 2 -2 

8 6 -8 6 ] |_0 0 2 2 

From this point the row reduction follows that of \JJ y] above, yielding the same result. 



1 0 0 1 " 

[L b]= -3 10 0- 

4-114 



. First, solve Ly = b: 


1 0 0 1] [1 0 0 f 

0 1 0 3 - 0 1 0 3, 

0 -1 1 oj [o 0 1 0 



Next solve Ux = y, using back-substitution (with matrix notation): 

"2 -1 2 1] [2 -1 0 -5] [2-10 -5" 

[U y]= 0 -3 4 3 - 0 -3 0 -9 - 0 1 0 3 

0 0 1 3j [o 0 1 3J [o 0 1 3 

“2 0 0 - 2 " 

- 0 1 0 3 , 

0 0 13 

so x = (-1, 3, 3). 
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1 

0 

0 " 


"2 

-2 

4' 


" 0" 

4. L = 

1/2 

1 

0 

,U = 

0 

-2 

-1 

,b = 

-5 


3/2 

-5 

1 


0 

0 

-6 


7 


First, solve Ly = b: 


[L b] = 


1 

0 

0 

0" 


"1 

0 

0 

0" 


"1 

0 

0 

0" 

1/2 

1 

0 

-5 

~ 

0 

1 

0 

-5 

~ 

0 

1 

0 

-5 

3/2 

-5 

1 

7 


0 

-5 

1 

7 


0 

0 

1 

-18 


so y = 


0 

-5 

-18 


Next solve Ux = y, using back-substitution (with matrix notation): 



"2 

-2 

4 

0 " 


“2 

-2 


4 i 

0 " 


“2 


-2 

0 


- 12 " 

[U y ] = 

0 

-2 

-1 

-5 

~ 

0 

-2 

- 

1 

5 

~ 

0 


-2 

0 


-2 


0 

0 

-6 

-18 


0 

0 


1 

3 


0 


0 

1 


3 


“2 

-2 

0 

- 12 " 


"2 

0 

0 

- 10 “ 


“1 

0 

0 

- 

- 5 “ 


~ 

0 

1 

0 

1 

~ 

0 

1 

0 

1 

~ 

0 

1 

0 


1 

9 


0 

0 

1 

3 


0 

0 

1 

3 


0 

0 

1 


3 



so x = (-5, 1, 3). 



1 

0 

0 

0“ 


“1 

-2 

-4 

-3" 


“f 


2 

1 

0 

0 


0 

-3 

1 

0 


7 

5. L = 

-1 

0 

1 

0 

,u = 

0 

0 

2 

1 

, b = 

0 


-4 

3 

-5 

1 


0 

0 

0 

1 


3 


First solve Ly = b: 


[L b] = 


1 

0 

0 

0 

f 


“1 

0 

0 

0 

f 

2 

1 

0 

0 

7 


0 

1 

0 

0 

5 

-1 

0 

1 

0 

0 


0 

0 

1 

0 

1 

-4 

3 

-5 

1 

3 


0 

3 

-5 

1 

7_ 

“1 

0 

0 

0 

f 


“1 

0 

0 

0 

f 

0 

1 

0 

0 

5 


0 

1 

0 

0 

5 

0 

0 

1 

0 

1 


0 

0 

1 

0 

1 

0 

0 

-5 

1 

-8 


0 

0 

0 

1 

-3 


so y ■ 


1 

5 

1 

-3 


Next solve Ux = y, using back-substitution (with matrix notation): 


[U y ] = 


“1 

-2 

-4 

-3 

1“ 


“1 

-2 

-4 

0 

-8" 

0 

-3 

1 

0 

5 


0 

-3 

1 

0 

5 

0 

0 

2 

1 

1 


0 

0 

2 

0 

4 

0 

0 

0 

1 

-3_ 


0 

0 

0 

1 

-3 
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1 

-2 

-4 

0 

-8' 


"1 

-2 

0 

0 

0" 

0 

-3 

1 

0 

5 


0 

-3 

0 

0 

3 

0 

0 

1 

0 

2 


0 

0 

1 

0 

2 

0 

0 

0 

1 

-3 


0 

0 

0 

1 

-3 


1 

-2 

0 

0 

0“ 


“1 

0 

0 

0 

-2 

0 

1 

0 

0 

-1 


0 

1 

0 

0 

-1 

0 

0 

1 

0 

2 


0 

0 

1 

0 

2 

0 

0 

0 

1 

-3 


0 

0 

0 

1 

-3 


so x = (-2, -1, 2, -3). 


6. L = 


1 

0 

0 

0" 


"1 

3 

4 

0" 


f 

-3 

1 

0 

0 

,u = 

0 

3 

5 

2 

,b = 

-2 

3 

-2 

1 

0 

0 

0 

-2 

0 

-1 

-5 

4 

-1 

1 


0 

0 

0 

1 


2 


.First, solve Ly = b: 


[L b] = 


1 


0 


0 

0 


f 


“1 

0 

0 

0 

f 

-3 


1 


0 

0 


-2 


0 

1 

0 

0 

1 

3 


-2 


1 

0 


-1 


0 

-2 

1 

0 

-4 

-5 


4 


-1 

1 


2 


0 

4 

-1 

1 

7_ 

“1 

0 


0 

0 


f 


“1 

0 

0 

0 

f 


0 

1 


0 

0 


1 


0 

1 

0 

0 

1 


0 

0 


1 

0 

- 

-2 


0 

0 

1 

0 

-2 

9 

0 

0 

- 

-1 

1 


3_ 


0 

0 

0 

1 

1 



so y = 


1 

1 

-2 

1 


Next solve Ux = y, using back-substitution (with matrix notation): 


“1 

3 

4 

0 

f 


“1 

3 

4 

0 

f 

0 

3 

5 

2 

1 


0 

3 

5 

0 

-1 

0 

0 

-2 

0 

-2 


0 

0 

-2 

0 

-2 

0 

0 

0 

1 

1 


0 

0 

0 

1 

1 


"1 

3 

4 

0 

f 


"1 

3 

0 

0 

-3' 

0 

3 

5 

0 

-1 


0 

3 

0 

0 

-6 

0 

0 

1 

0 

1 


0 

0 

1 

0 

1 

0 

0 

0 

1 

1 


_0 

0 

0 

1 

1 

"1 

3 

0 

0 

-3" 


“1 

0 

0 

0 

3" 

0 

1 

0 

0 

-2 


0 

1 

0 

0 

-2 

0 

0 

1 

0 

1 


0 

0 

1 

0 

1 

0 

0 

0 

1 

1 


0 

0 

0 

1 

1 


so x = (3, -2, 1,1). 
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7. Place the first pivot column of 


into L, after dividing the column by 2 (the pivot), then add 


3/2 times row 1 to row 2, yielding U. 



-s-2 -5-7/2 

1 i 

1 0 

-3/2 1 


1 

-3/2 1 ’ 


8. Row reduce A to echelon form using only row replacement operations. Then follow the algorithm in 
Example 2 to find L. 


A = 


'© 9 

"6 9 ' 

_4 5 _ ' 

0 0 . 


= U 


4 

* 6 "5 1 

1 i 

1 

2/3 1 


L = 


1 0 
2/3 1 



"(D 

-1 

2" 


"3 

-1 

2" 


"3 

-1 

2" 

9. A = 

-3 

-2 

10 

~ 

0 

0 

12 

~ 

0 

-3 

12 


9 

-5 

6 


0 

-2 

0 


0 

0 

@J 



i i I 


1 



1 

0 

0" 

-1 

1 

, L = 

-1 

1 

0 

3 

2/3 1 


3 

2/3 

1 
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3 4] [-5 3 4] [-5 3 4 

10 . A = 10 -8 -9 ~ 0 0 - 1 - 0 -2 -1 =U 

15 1 2 J [_ 0 1° M J [_ 0 0 ®- 

01 

10 r@" 

_ 15 J L10J 0 ] 

+ -5 +-2 +9 

I i i 

1 1 [10 0 

-2 1 , L= -2 10 

-3 -5 lj |_-3 -5 1 



12 . Row reduce A to echelon form using only row replacement operations. Then follow the algorithm in 
Example 2 to find L. Use the last column of / 3 to make L unit lower triangular. 



1 1 [ 1 0 O' 

1/2 1 , L= 1/2 10 

-3 -2 1J |_-3 -2 1 
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13 . 



3 

-5 

- 3 ' 


“1 

3 -5 

- 3 ' 


“1 

3 

-5 

- 3 ' 

-1 

-5 

8 

4 


0 

Q> 3 

1 


0 

-2 

3 

1 

4 

2 

-5 

-7 


0 

-10 15 

5 


0 

0 

0 

0 

-2 

-4 

7 

5 _ 


0 

2 -3 

-1 


0 

0 

0 

0 


No more pivots! 



Use the last two columns of I A to make L unit lower triangular. 


+ 1 +— 2 


1 i 


1 





1 

0 

0 

0 " 

-1 

1 



, L = 

-1 

1 

0 

0 

4 

5 

It 

f 


4 

5 

1 

0 

-2 

-1 

0 

1 


-2 

-1 

0 

1 


14 . 


'CD 

4 

-1 

5 ’ 


“1 

4 

-1 

5 ’ 


“1 

4 

-1 

5 ' 

3 

7 

-2 

9 


0 

@ 

1 

-6 


0 

-5 

1 

-6 

-2 

-3 

1 

-4 


0 

5 

-1 

6 


0 

0 

0 

0 

-1 

6 

-1 

7 _ 


0 

10 

-2 

12 


0 

0 

0 

0 



Use the last two columns of I 4 to make L unit lower triangular. 


+ 1 +-5 

i i 
1 

3 1 

-2 -1 1 ▼ 
-1 -2 0 



0 0 

1 0 

-1 1 

-2 0 


0 

0 

0 

1 
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'© -4 4 -2l [2 -4 4 -2] [2 -4 4 -2 

15 . A= 6 -9 7 -3 - 0 (3) -5 3 - 0 3 -5 3 =U 

-1 -4 8 Oj |_0 -6 10 -lj [o 0 0 © 



1 1 i 

i i r ioo 

31 , L= 310 

-1/2 -2 lj [-1/2 -2 1 



1 0 0 4 3 -5 

17 . L= -1 1 0 , U = 0 -2 2 To find ZT 1 2 , use the method of Section 2.2; that is, row 

2 0 lj [o 0 2 

reduce [L /]: 

1 0 0 1 0 0 ] [ 1 0 0 1 0 0 " 

[L /]= -1 10 0 10-0 10 1 1 0 =[/ L~% 

2 0 1 0 0 lj [o 0 1-2 0 1 
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SO L 1 = 


1 

1 

-2 


0 0 
1 0 
0 1 


Likewise to find U row reduce \U I] : 


[U /] = 


"4 

3 

-5 

1 

0 

O' 


"4 

3 

0 

1 

0 

5/2' 

0 

-2 

2 

0 

1 

0 

~ 

0 

-2 

0 

0 

1 

-1 

0 

0 

2 

0 

0 

1 


0 

0 

2 

0 

0 

1 


"4 

0 

0 

1 

3/2 

l" 


'1 

0 

0 

1/4 

3/8 

1/4' 


0 

-2 

0 

0 

1 

-1 

~ 

0 

1 

0 

0 

-1/2 

1/2 

= [/ U~ l ], 

0 

0 

2 

0 

0 

1 


0 

0 

1 

0 

0 

1/2 



so U 1 = 


1/4 

0 

0 


3/8 1/4' 

- 1/2 1/2 
0 1/2 


.Thus 



'1/4 

3/8 

1/4' 

1 

0 

o' 


1/8 

3/8 

1/4' 

A~ l = U~ l L~ l = 

0 

-1/2 

1/2 

1 

1 

0 

= 

-3/2 

-1/2 

1/2 


0 

0 

1/2 

-2 

0 

1 


-1 

0 

1/2 



1 

0 

O' 


'2 

-1 

2" 

li 

00 

-3 

1 

0 

, u = 

0 

-3 

4 


4 

-1 

1 


0 

0 

1 


T o find L 1 , row reduce [L I]: 


[L /] = 


1 

0 

0 

1 

0 

O' 


'1 

0 

0 

1 

0 

0" 

-3 

1 

0 

0 

1 

0 

~ 

0 

1 

0 

3 

1 

0 

4 

-1 

1 

0 

0 

1 


0 

-1 

1 

-4 

0 

1 


= '_I L~ l ], 


so L 1 = 


10 0 10 0 

0 10 3 10 

001-111 

1 0 0~ 

3 1 0 . Likewise to find U~ l , row reduce [(7 /]: 

-1 1 1 






"2 

-1 

2 

1 0 

0" 


"2 

-1 

0 

1 0 

-2" 


[U 

I] 

= 

0 

-3 

4 

0 1 

0 

~ 

0 

-3 

0 

0 1 

-4 





0 

0 

1 

0 0 


1 


0 

0 

1 

0 0 

1 


"2 

-1 

0 

1 

0 

-2' 


"2 

0 

0 

1 

-1/3 

-2/3' 

~ 

0 

1 

0 

0 - 

-1/3 

4/3 

~ 

0 

1 

0 

0 

-1/3 

4/3 


0 

0 


1 

0 

0 

1 


0 

0 

1 

0 

0 

1 


"1 

0 

0 


1/2 

-1/6 

-1/3' 








~ 

0 

1 

0 


0 

-1/3 

4/3 

= 

[/ 

u~ 

4 ], 





0 

0 

1 


0 

0 


1 
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"1/2 

-1/6 

-1/3' 


so U 1 = 

0 

-1/3 

4/3 

.Thus 


0 

0 

1 




"1/2 

-1/6 

-1/3" 

1 

0 

O' 


1/3 

-1/2 

-1/3" 

A~ l = U~ l L~ l = 

0 

-1/3 

4/3 

3 

1 

0 

= 

-7/3 

1 

4/3 


0 

0 

1 

-1 

1 

1 


-1 

1 

1 


19 . Let A be a lower-triangular n x n matrix with nonzero entries on the diagonal, and consider the 
augmented matrix \A I\ . 

a. The (1, l)-entry can be scaled to 1 and the entries below it can be changed to 0 by adding multiples 
of row 1 to the rows below. This affects only the first column of A and the first column of I. So the 
(2, 2)-entry in the new matrix is still nonzero and now is the only nonzero entry of row 2 in the first 
n columns (because A was lower triangular). 

The (2, 2)-entry can be scaled to 1, the entries below it can be changed to 0 by adding multiples 
of row 2 to the rows below. This affects only columns 2 and n + 2 of the augmented matrix. Now the 
(3, 3) entry in A is the only nonzero entry of the third row in the first n columns, so it can be scaled to 
1 and then used as a pivot to zero out entries below it. Continuing in this way, A is eventually reduced 
to /, by scaling each row with a pivot and then using only row operations that add multiples of the 
pivot row to rows below. 

b. The row operations just described only add rows to rows below, so the / on the right in \A 7] changes 
into a lower triangular matrix. By Theorem 7 in Section 2.2, that matrix is A '. 

20 . Let A = LU be an LU factorization for A. Since L is unit lower triangular, it is invertible by Exercise 19. 
Thus by the Invertible Matrix Theroem, L may be row reduced to I. But L is unit lower triangular, so it 
can be row reduced to I by adding suitable multiples of a row to the rows below it, beginning with the top 
row. Note that all of the described row operations done to L are row-replacement operations. If 
elementary matrices E u E 2 , ... E p implement these row-replacement operations, then 

E p ...E 2 E 1 A = (E p ...E 2 E l )LU = IU = U 

This shows that A may be row reduced to U using only row-replacement operations. 

21 . (Solution in Study Guide) Suppose A = BC, with B invertible. Then there exist elementary matrices 

E i, . . . , E p corresponding to row operations that reduce B to /, in the sense that E p ... E\B = I. Applying 
the same sequence of row operations to A amounts to left-multiplying A by the product E p ... £j . By 
associativity of matrix multiplication. 

E p ... E { A = E p ... E X BC = IC = C 
so the same sequence of row operations reduces A to C. 

22 . First find an LU factorization for A. Row reduce A to echelon form using only row replacement 
operations: 



-4 

-2 

3" 


"2 

-4 

-2 

3" 


"2 

-4 

-2 

3" 

6 

-9 

-5 

8 


0 

CD 

1 

-1 


0 

3 

1 

-1 

2 

-7 

-3 

9 

~ 

0 

-3 

-1 

6 

~ 

0 

0 

0 

© 

4 

-2 

-2 

-1 


0 

6 

2 

-7 


0 

0 

0 

-5 

-6 

3 

3 

4 


0 

-9 

-3 

13 


0 

0 

0 

10 
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"2 

-4 

-2 

3" 


0 

3 

1 

-1 

~ 

0 

0 

0 

5 


0 

0 

0 

0 


0 

0 

0 

0 

then follow the algorithm in 

triangular. 





"( 

2) 






6 


'(1) 





2 


-3 






4 


6 


-5 



- 

-6 


-9 


10 


-J- 

2 

+ 3 


+■ 5 



=u 


i I i 


1 





1 

0 

0 

0 

0" 

3 

1 




3 

1 

0 

0 

0 

1 

-1 

1 


, L = 

1 

-1 

1 

0 

0 

2 

2 

-1 1 



2 

2 

-1 

1 

0 

-3 

-3 

2 0 

1 


-3 

3 

2 

0 

1 


Now notice that the bottom two rows of U contain only zeros. If one uses the row-column method to find 
LU, the entries in the final two columns of L will not be used, since these entries will be multiplied zeros 
from the bottom two rows of U. So let B be the first three columns of L and let C be the top three rows of 
U. That is, 


B = 


1 

3 

1 

2 

-3 


0 

1 

-1 

2 

3 


, C = 


-4 

3 

0 


-2 

1 

0 


3 

-1 

5 


Then B and C have the desired sizes and BC = LU = A. We can generalize this process to the case where 
A in m x n, A=LU, and U has only three non-zero rows: let B be the first three columns of L and let C be 
the top three rows of U. 


23. a. Express each row of D as the transpose of a column vector. Then use the multiplication rule for 
partitioned matrices to write 


A = CD = [ Ci c 2 c 3 c 4 ] 


d[ 


= Cjd[ +c 2 dj 


+ c 3 d 3 r 


+ c 4 dj 


which is the sum of four outer products. 

b. Since A has 400 x 100 = 40000 entries, C has 400 x 4 = 1600 entries and D has 4 x 100 = 400 entries, 
to store C and D together requires only 2000 entries, which is 5% of the amount of entries needed to 
store A directly. 
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24 . Since Q is square and Q r Q = /, Q is invertible by the Invertible Matrix Theorem and Q 1 = Q r . Thus A is 
the product of invertible matrices and hence is invertible. Thus by Theorem 5, the equation Ax - b has a 
unique solution for all b. From Ax = b, we have QRx = b, Q T QRx = Q T b, Rx = Q T b, and finally x = 

R Q b. A good algorithm for finding x is to compute Q b and then row reduce the matrix [R Q b ]. See 
Exercise 1 1 in Section 2.2 for details on why this process works. The reduction is fast in this case 
because R is a triangular matrix. 

25 . A = UDV T . Since U and V 1 are square, the equations U 1 U = I and V T V= I imply that U and V 1 are 
invertible, by the IMT, and hence U~ x = U T and (V T )~ X = V. Since the diagonal entries cr, , . . . , a n in D are 

nonzero, D is invertible, with the inverse of D being the diagonal matrix with , . . . , 1 on the 

diagonal. Thus A is a product of invertible matrices. By Theorem 6, A is invertible and AT 1 = ( UDV r ) " 1 = 
{V T )~ l D~ l LT x = VD~ x U r . 


26. If A = PDF ', where P is an invertible 3><3 matrix and D is the diagonal matrix 


D = 


1 

0 

0 


0 

1/2 

0 


0 

0 

1/3 


then 


A 2 =(PDP~ x )(PDP~ x ) = PD(P~ l P)DP~ l = PD1DP~ X =PD 2 P~ X 


and since 



“1 

0 

0" 

“1 

0 

0“ 


“1 

0 

o' 


'1 

0 

0" 

D 2 = 

0 

1/2 

0 

0 

1/2 

0 

= 

0 

1/2 2 

0 

= 

0 

1/4 

0 


0 

0 

1/3 

0 

0 

1/3 


0 

0 

1/3 2 


0 

0 

1/9 


A 2 =P 


1 0 0 
0 1/4 0 

0 0 1/9 


i-i 


Likewise, A 3 = PD 3 P ', so 



"1 

0 

O' 



"1 

0 

o' 

A 3 =P 

0 

1/2 3 

0 

P x 

= P 

0 

1/8 

0 


0 

0 

1 / 3 3 _ 



0 

0 

1/27 

general, A‘ 

’( 

PD k P\ 

so 







"1 

0 

O' 






A k = P 

0 

1 / 2 a 

0 

P ~ 1 






0 

0 

1/3* 







27. First consider using a series circuit with resistance R\ followed by a shunt circuit with resistance AS for 
the network. The transfer matrix for this network is 


1 O ' 

'1 

-Rx 


l 

"^1 

- 1/^2 1 . 

0 

l 


" 1/^2 

(R\ + ^ 2 ) ! Ri _ 
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For an input of 12 volts and 6 amps to produce an output of 9 volts and 4 amps, the transfer matrix must 
satisfy 


1 -R, 

"12" 


1 

K> 

1 

On 

>3 

i 


" 9 " 

-l/R 2 (R { +R 2 )IR 2 _ 

6 


(-12 + 6^ + 6 R 2 )/R 2 


4 


Equate the top entries and obtain R { = 4 ohm. Substitute this value in the bottom entry and solve to 
obtain R 2 = 2 ohms. The ladder network is 


a. 



— 

i i 

* 2 g g 2 

— 

» * 3 t 

v i 

1/2 ohm 

V 2 

> 9/2 
">ohms 

V 3 









Next consider using a shunt circuit with resistance Ri followed by a series circuit with resistance /T for 
the network. The transfer matrix for this network is 


"1 -r 2 

1 

0" 


\R 1 +R 2 )/R l 

-Ri 

0 1 

-l/R l 

1 


-l/R l 

l 


For an input of 12 volts and 6 amps to produce an output of 9 volts and 4 amps, the transfer matrix must 
satisfy 


(Ri +^2)^1 Ri 

“12" 


"( 12 R { + 12 R 2 )/R l - 6 R 2 


" 9 " 

-1 !R { 1 

6 


-12 /R { +6 


4 


Equate the bottom entries and obtain Ri = 6 ohms. Substitute this value in the top entry and solve to 
obtain R 2 = Tohms. The ladder network is 



- 


i i 

t 2 * w 2 

— 

► ?3 * 

v i 


: 6 
► ohms 

V 2 

3/4 ohm 

V 3 


_ 




— 



28. The three shunt circuits have transfer matrices 


1 

0" 

1 

0" 

, and 

1 

0" 

-1/^! 

1 

L - 1/^2 

1 

- 1 /R 3 

1 


respectively. To find the transfer matrix for the series of circuits, multiply these matrices 


1 0" 

1 0" 

, and 

1 0" 


1 0" 

-IAR3 1 

\_-HR2 1 

-1 !R X 1 


-(1 + 1 /i? 2 + 1 /i? 3 ) 1 


Thus the resulting network is itself a shunt circuit with resistance 1 /R l + 1 !R 2 + l/R 3 . 


29. a. The first circuit is a shunt circuit with resistance Ri ohms, so its transfer matrix is 

The second circuit is a series circuit with resistance i? 2 ohms, so its transfer matrix is 


l/R l 

“1 

0 


0 

1 

~Ri 

1 
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The third circuit is a shunt circuit with resistance R 3 ohms so its transfer matrix is 


-1 /R, 


The transfer matrix of the network is the product of these matrices, in right-to-left order: 


0 

1 


1 o' 

"1 -Ri 

1 

0' 


(/?, + /? 2 )//?, 

-r 2 

-1/R 3 1 

0 1 

-\/R l 

1 


_—(Ri + R 2 + R 2 ) IR 2 

(R 2 + R 3 ) IR 3 _ 


b. To find a ladder network with a structure like that in part (a) and with the given transfer matrix A, we 
must find resistances R\, R 2 , and R 2 such that 


'4/3 

- 12 ' 


(R^+R^IR, 

-r 2 

-1/4 

3 _ 


— (jRj + R 2 + -^3 ) / 

(R 2 + r 3 ) ir 3 _ 


From the (1,2) entries, i ? 2 = 12 ohms. The (1,1) entries now give (R ] + 12) IR X = 4/3, which may be 
solved to obtain R\ = 36 ohms. Likewise the (2, 2) entries give (R 3 + 12 )/R 3 = 3, which also may be 
solved to obtain R 3 = 6 ohms. Thus the matrix A may be factored as 


A = 


1 

o' 

"1 

-Rf 

1 

O' 

1 / R 3 

1 

0 

1 

-1 /Ri 

1 


1 

O' 

'1 

- 12 ' 

1 

O' 

1/6 

1 

0 

1 

-1/36 

1 


The ladder network is 



— 

i i ' 

• fcr 2 ' AAA 

i { 

h % *3 

— 

,< 4 , 

v i 

s 36 

y ohms 

! 12 ohms 

■ 

1 

1 

V 3 

s 6 

Sohms 

V 4 




~ n 

1 






30. An s wers may vary. The network below interchanges the series and shunt circuits. 



The transfer matrix of this network is the product of the individual transfer matrices, in right-to-left 
order. 


T 1 

o' 

'1 

-Ri~ 

_[-l/R 2 

1 

_0 

1 


( R-) T R ; ) R ' — R ; — A/ ( A. + R ; ) //, 

-1/R 2 (A, + If) Ilf 


By setting the matrix A from the previous exercise equal to this matrix, one may find that 



— (i?2 ^3 ) ! R 2 


' 4/3 

-12' 

-1 /R 2 

+ i?2 ) /^?2 


-1/4 

3 _ 


Set the (2, 1) entries equal and obtain R 2 = 4 ohms. Substitute this value for R 2 , equating the (2, 2) entries 
and solving gives R] = 8 ohms. Likewise equating the (1, 1) entries gives R 3 = 4/3 ohms. 
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The ladder network is 



— 

7 7 

► 2 • i 2 

r - 

— 

i i 

► 3 • i 3 

— 

,' 4 . 

V 1 

8 ohms 

V 2 


, 4 
► ohms 

V 3 

4/3 ohms 

V 4 





L _ 








Note: The Study Guide’s MATLAB box for Section 2.5 suggests that for most LU factorizations in this 
section, students can use the gauss command repeatedly to produce U, and use paper and mental 
arithmetic to write down the columns of L as the row reduction to U proceeds. This is because for Exercises 
7-16 the pivots are integers and other entries are simple fractions. However, for Exercises 31 and 32 this is 
not reasonable, and students are expected to solve an elementary programming problem. (The Study Guide 
provides no hints.) 

3E [Ml Store the matrix A in a temporary matrix B and create L initially as the 8><8 identity matrix. The 
following sequence of MATLAB commands fills in the entries of L below the diagonal, one column at a 
time, until the first seven columns are filled. (The eighth column is the final column of the identity 
matrix.) 

L (2 : 8 , 1) = B (2 : 8 , 1)/B(1, 1) 

B = gauss (B, 1) 

L ( 3 : 8 , 2) = B ( 3 : 8 , 2)/B(2, 2) 

B = gauss (B, 2) 

L ( 8 : 8 , 7) = B(8:8, 7) /B(7, 7) 

U = gauss (B, 7) 

Of course, some students may realize that a loop will speed up the process. The f or . . end syntax is 
illustrated in the MATLAB box for Section 5.6. Here is a MATLAB program that includes the initial 
setup of i? andT: 

B = A 
L = eye ( 8 ) 
for j =1 : 7 

L ( j +1 : 8 , j) = B ( j +1 : 8 , j)/B(j, j) 

B = gauss (B, j ) 
end 
U = B 


a. To four decimal places, the results of the LU decomposition are 




1 

0 

0 

0 

0 

0 

0 

0 


-.25 

1 

0 

0 

0 

0 

0 

0 


-.25 

-.0667 

1 

0 

0 

0 

0 

0 


0 

-.2667 

-.2857 

1 

0 

0 

0 

0 

L = 

0 

0 

-.2679 

-.0833 

1 

0 

0 

0 


0 

0 

0 

-.2917 

-.2921 

1 

0 

0 


0 

0 

0 

0 

-.2697 

-.0861 

1 

0 


0 

0 

0 

0 

0 

-.2948 

-.2931 

1 
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'4 -1 -1 0 0 0 0 0 

0 3.75 -.25 -1 0 0 0 0 

0 0 3.7333 -1.0667 -1 0 0 0 

0 0 0 3.4286 -.2857 -1 0 0 

U = 

0 0 0 0 3.7083 -1.0833 -1 0 

0 0 0 0 0 3.3919 -.2921 -1 

0 0 0 0 0 0 3.7052 -1.0861 

0 0 0 0 0 0 0 3.3868 

b. The result of solving Ly - b and then Ux = y is 

x = (3.9569, 6.5885, 4.2392, 7.3971, 5.6029, 8.7608, 9.41 15, 12.0431) 


.2953 

.0866 

.0945 

.0509 

.0318 

.0227 

.0010 

.0082 

.0866 

.2953 

.0509 

.0945 

.0227 

.0318 

.0082 

.0100 

.0945 

.0509 

.3271 

.1093 

.1045 

.0591 

.0318 

.0227 

.0509 

.0945 

.1093 

.3271 

.0591 

.1045 

.0227 

.0318 

.0318 

.0227 

.1045 

.0591 

.3271 

.1093 

.0945 

.0509 

.0227 

.0318 

.0591 

.1045 

.1093 

.3271 

.0509 

.0945 

.0010 

.0082 

.0318 

.0227 

.0945 

.0509 

.2953 

.0866 

.0082 

.0100 

.0227 

.0318 

.0509 

.0945 

.0866 

.2953 


3-1000 

- 13-100 

32. [M]J = 0 -1 3 -1 0 . The commands shown for Exercise 31, but modified for 5x5 

0 0-1 3-1 

0 0 0 -1 3 

matrices, produce 

' 1 0 0 0 O' 

-f 1 0 00 

L= 0 — f 1 00 

0 o — lr i o 

oo o -§ i_ 

"3 -1 0 0 0 " 

0 | -1 0 0 

U = 0 0 f -1 0 

0 0 0 If -1 

0 0 0 0 ^ 
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b. Let s k +\ be the solution of Ls kl i = t k for k = 0, 1,2, .... Then t k +\ is the solution of Ut k+l = s*+i 
for k = 0, 1,2, .... The results are 


10.0000" 


“ 6.5556" 


" 6.5556" 


"4.7407" 

15.3333 


9.6667 


11.8519 


7.6667 

17.7500 

?tl — 

10.4444 

?§2 _ 

14.8889 

>*2 : 

= 

8.5926 

18.7619 


9.6667 


15.3386 


7.6667 

17.1636 


6.5556 


12.4121 


4.7407 

' 4.7407" 


"3.5988" 


"3.5988" 


"2.7922" 


9.2469 


6.0556 


7.2551 


4.7778 


12.0602 

’*3 = 

6.9012 

,s 4 = 

9.6219 

5 t 4 

5.4856 


12.2610 


6.0556 


9.7210 


4.7778 


9.4222 


3.5988 


7.3104 


2.7922 



2.6 SOLUTIONS 

Notes: This section is independent of Section 1.10. The material here makes a good backdrop for the series 
expansion of ( I-C) 1 because this formula is actually used in some practical economic work. Exercise 8 gives 
an interpretation to entries of an inverse matrix that could be stated without the economic context. 

1. The answer to this exercise will depend upon the order in which the student chooses to list the sectors. 
The important fact to remember is that each column is the unit consumption vector for the appropriate 
sector. If we order the sectors manufacturing, agriculture, and services, then the consumption matrix is 


10 

.60 

.60 

30 

.20 

0 

30 

.10 

.10 


The intermediate demands created by the production vector x are given by Cx. Thus in this case the 
intermediate demand is 



'.10 

.60 

.60" 

O' 


"60" 

Cx = 

.30 

.20 

.00 

100 

= 

20 


.30 

.10 

.10 

0 


10 


2. Solve the equation x = Cx + d for d: 



x i 


".10 

.60 

.60" 

x i 


.9xj 

-.6x 2 

so 

f 


" 0 " 

d=x-Cx= 

x 2 

- 

.30 

.20 

.00 

X 2 

= 

-,3xj 

+.8^2 


= 

18 


_ X 3_ 


.30 

.10 

.10 

_ X 3 _ 


-.3xj 

-1*2 

+.9x 3 


0 


This system of equations has the augmented matrix 


'-.90 

-.60 

-.60 

O' 


"1 

0 

0 

33.33" 

-.30 

.80 

.00 

18 

~ 

0 

1 

0 

35.00 

-.30 

-.10 

.90 

0 


0 

0 

1 

15.00 


sox = (33.33, 35.00, 15.00). 
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3. Solving as in Exercise 2: 



*i 


‘.10 

.60 

.60 

T 


.Ox, 

J 

OS 

* 

to 

~. 6 x 3 


"18" 

d = x -Cx = 

x 2 

- 

.30 

.20 

.00 

x 2 

= 

-.3xj 

+.8x 2 


= 

0 


_ X 3_ 


.30 

.10 

.10 

_ X 3. 


-3x { 

- 1 x 2 

+. 9 x 3 


0 


This system of equations has the augmented matrix 


.90 

-.60 

-.60 

18' 


"1 

0 

0 

40.00" 

-.30 

.80 

.00 

0 

~ 

0 

1 

0 

15.00 

-.30 

-.10 

.90 

0 


0 

0 

1 

15.00 


sox = (40.00, 15.00, 15.00). 
4. Solving as in Exercise 2: 





"TO 

.60 

.60" 



.Ox, 

~.6x 2 

-,6x 3 


"18" 

d = x -Cx = 

*2 

- 

.30 

.20 

.00 

x 2 

= 

-.3xj 

+.8^2 


= 

18 


_ X 3_ 


.30 

.10 

.10 

_ X 3_ 


-.3X[ 

-lx 2 

+.9x 3 


0 


This system of equations has the augmented matrix 


"-.90 

-.60 

-.60 

18" 


"1 

0 

0 

73.33" 

-.30 

.80 

.00 

18 

~ 

0 

1 

0 

50.00 

-.30 

-.10 

.90 

0 


0 

0 

1 

30.00 


sox = (73.33, 50.00, 30.00). 

Note: Exercises 2-4 may be used by students to discover the linearity of the Leontief model. 


5. 


6 . 


x = (/-C) _1 d = 
x = (/-C) _1 d = 


--1 

"50" 


"1.6 

f 

"50" 


" 110 " 


20 


1.2 

2 

20 


120 


' .9 -.6" 

-1 

"18" 


"40/21 30/21" 

'18' 


"50" 

-.5 .8 


11 


25/21 45/21 

11 


_45_ 


7. a. From Exercise 5, 


(i-cy l 


1.6 1 

1.2 2 


so 

1.6 
1.2 

which is the first column of (/ - C) -1 . 


x 1 =(7-C)- 1 d 1 = 


" 1.6 

1 " 

1 


1.2 

2 

0 



b. 


x 2 = (/-C) *d 2 


"1.6 

1" 

"51" 


"111.6" 

1.2 

2 

30 


121.2 
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'50' 


"110" 

c. From Exercise 5, the production x corressponding to d = 

20 

is x = 

120 


Note that d 2 =d + d 1 . Thus 
x 2 =(/-C)“ 1 d 2 
= (/-C)-‘(d + d 1 ) 

= (/-Cr 1 d + (/-C) _1 d 1 

= X + Xj 


8. a. Given (/- C)x = d and (/- C)Ax = Ad, 

(7 - C)(x + Ax) = (7 - C)x + (7 - C)Ax = d + Ad 
Thus x + Ax is the production level corresponding to a demand of d + Ad . 
b. Since Ax = (7-C)~'Ad and Ad is the first column of 7, Ax will be the first column of (/ — C) _1 . 


9. In this case 


7-C = 


.8 


-.3 

-.1 


-.2 .0 

.9 -.3 

.0 .8 


Row reduce [7 - C d ] to find 


" .8 

-.2 

.0 

40.0' 


'1 

0 

0 

82.8" 

-.3 

.9 

-.3 

60.0 

~ 

0 

1 

0 

131.0 

-.1 

.0 

.8 

80.0 


0 

0 

1 

110.3 


Sox = (82.8, 131.0, 110.3). 


10. From Exercise 8, the (/, j) entry in (7- C) 1 corresponds to the effect on production of sector i when the 
final demand for the output of sector j increases by one unit. Since these entries are all positive, an 
increase in the final demand for any sector will cause the production of all sectors to increase. Thus an 
increase in the demand for any sector will lead to an increase in the demand for all sectors. 

11. (Solution in study Guide ) Following the hint in the text, compute px in two ways. First, take the 
transpose of both sides of the price equation, p = C r p + v, to obtain 

p T = (C r p + v) r = (C T p) r + v r = p r C + v r 

and right-multiply by x to get 

p r x =(p r C + v r )x = p r Cx + v r x 

Another way to compute p 7 x starts with the production equation x = Cx + d. Left multiply by p r to get 
p r x = p 7 (Cx + d) =p r Cx + p r d 
The two expression for p r x show that 
p r Cx + v r x = p 7 Cx + p r d 

so v 7 x = p 7 d. The Study Guide also provides a slightly different solution. 


12. Since 

D m+ 1 =I + C + C 2 +... + C m+l = 7 + C(7 + C + ... + C m ) = I + CD m 
D m+l may be found iteratively by D m+] = 7 + CD m . 
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13. [M] The matrix I - C is 


0.8412 

-0.0064 - 

0.0025 

-0.0304 

-0.0014 

-0.0083 

-0.1594" 


-0.0057 

0.7355 - 

0.0436 

-0.0099 

-0.0083 

-0.0201 

-0.3413 


-0.0264 

-0.1506 

0.6443 

-0.0139 

-0.0142 

-0.0070 

-0.0236 


-0.3299 

-0.0565 - 

0.0495 

0.6364 

-0.0204 

-0.0483 

-0.0649 


-0.0089 

-0.0081 - 

0.0333 

-0.0295 

0.6588 

-0.0237 

-0.0020 


-0.1190 

-0.0901 - 

0.0996 

-0.1260 

-0.1722 

0.7632 

-0.3369 


-0.0063 

-0.0126 - 

0.0196 

-0.0098 

-0.0064 

-0.0132 

0.9988 


augmented matrix [I - C d ] may be row reduced to 

find 




0.8412 

-0.0064 - 

0.0025 

-0.0304 

-0.0014 

-0.0083 

-0.1594 

74000 

-0.0057 

0.7355 - 

0.0436 

-0.0099 

-0.0083 

-0.0201 

-0.3413 

56000 

-0.0264 

-0.1506 

0.6443 

-0.0139 

-0.0142 

-0.0070 

-0.0236 

10500 

-0.3299 

-0.0565 - 

0.0495 

0.6364 

-0.0204 

-0.0483 

-0.0649 

25000 

-0.0089 

-0.0081 - 

0.0333 

-0.0295 

0.6588 

-0.0237 

-0.0020 

17500 

-0.1190 

-0.0901 - 

0.0996 

-0.1260 

-0.1722 

0.7632 

-0.3369 

196000 

-0.0063 

-0.0126 - 

0.0196 

-0.0098 

-0.0064 

-0.0132 

0.9988 

5000 



"1 0 

0 0 0 

0 0 

99576" 






0 1 

0 0 0 

0 0 

97703 






0 0 

1 0 0 

0 0 

51231 





~ 

0 0 

0 1 0 

0 0 

131570 






0 0 

0 0 1 

0 0 

49488 






0 0 

0 0 0 

i o : 

329554 






0 0 

0 0 0 

0 1 

13835_ 





so x = (99576, 97703, 51321, 131570, 49488, 329554, 13835). Since the entries in d seem to be accurate 
to the nearest thousand, a more realistic answer would be x = (100000, 98000, 51000, 132000, 49000, 
330000, 14000). 

14. [M] The augmented matrix [I - C d ] in this case may be row reduced to find 


0.8412 

-0.0064 

-0.0025 

-0.0304 

-0.0014 

-0.0083 

-0.1594 

99640 

-0.0057 

0.7355 

-0.0436 

-0.0099 

-0.0083 

-0.0201 

-0.3413 

75548 

-0.0264 

-0.1506 

0.6443 

-0.0139 

-0.0142 

-0.0070 

-0.0236 

14444 

-0.3299 

-0.0565 

-0.0495 

0.6364 

-0.0204 

-0.0483 

-0.0649 

33501 

-0.0089 

-0.0081 

-0.0333 

-0.0295 

0.6588 

-0.0237 

-0.0020 

23527 

-0.1190 

-0.0901 

-0.0996 

-0.1260 

-0.1722 

0.7632 

-0.3369 

263985 

-0.0063 

-0.0126 

-0.0196 

-0.0098 

-0.0064 

-0.0132 

0.9988 

6526 
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0 

1 


0 0 
0 0 
0 0 
0 0 
0 0 


0 0 
0 0 
1 0 
0 1 
0 0 
0 0 
0 0 


000 134034 

000 131687 

000 69472 

0 0 0 176912 

1 0 0 66596 

0 1 0 443773 

0 0 1 18431 


sox = (134034, 131687, 69472, 176912, 66596,443773, 18431). To the nearest thousand, x = (134000, 
132000, 69000, 177000, 67000, 444000, 18000). 


15 . [M] Here are the iterations rounded to the nearest tenth: 

x (0) = (74000.0, 56000.0, 10500.0, 25000.0, 17500.0, 196000.0, 5000.0) 
x (1) =(89344.2, 77730.5, 26708.1, 72334.7, 30325.6, 265158.2, 9327.8) 
x (2) =(94681.2, 87714.5, 37577.3, 100520.5, 38598.0, 296563.8, 1 1480.0) 
x (3) =(97091.9, 92573.1, 43867.8, 1 15457.0, 43491.0, 312319.0, 12598.8) 
x (4) =(98291.6, 95033.2, 47314.5, 123202.5, 46247.0, 320502.4, 13185.5) 
x (5) =(98907.2, 96305.3, 49160.6, 127213.7, 47756.4, 324796.1, 13493.8) 
x <6) = (99226.6, 96969.6, 50139.6, 129296.7, 48569.3, 327053.8, 13655.9) 
x (7) =(99393.1, 97317.8, 50656.4, 130381.6, 49002.8, 328240.9, 13741.1) 
x (8) =(99480.0, 97500.7, 50928.7, 130948.0, 49232.5, 328864.7, 13785.9) 
x (9) =(99525.5, 97596.8, 51071.9, 131244.1, 49353.8, 329192.3, 13809.4) 
x (10) =(99549.4, 97647.2, 51147.2, 131399.2, 49417.7, 329364.4, 13821.7) 
x (11) =(99561.9, 97673.7, 51186.8, 131480.4, 49451.3, 329454.7, 13828.2) 
x (12) =(99568.4, 97687.6, 51207.5, 131523.0, 49469.0, 329502.1, 13831.6) 

so x (I2) is the first vector whose entries are accurate to the nearest thousand. The calculation of x <12) takes 
about 1260 flops, while the row reduction above takes about 550 flops. If C is larger than 20 x 20, then 
fewer flops are required to compute x (12) by iteration than by row reduction. The advantage of the 
iterative method increases with the size of C. The matrix C also becomes more sparse for larger models, 
so fewer iterations are needed for good accuracy. 


2.7 SOLUTIONS 

Notes: The content of this section seems to have universal appeal with students. It also provides practice with 
composition of linear transformations. The case study for Chapter 2 concerns computer graphics - see this 
case study (available as a project on the website) for more examples of computer graphics in action. The 
Study Guide encourages the student to examine the book by Foley referenced in the text. This section could 
form the beginning of an independent study on computer graphics with an interested student. 
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1. Refer to Example 5. The representation in homogenous coordinates can be written as a partitioned matrix 
A 0" 

of the form „ , where A is the matrix of the linear transformation. Since in this case 


A = 


1 .25 

0 1 

1 .25 0 

0 1 0 

0 0 1 


0 !. 

the representation of the transformation with respect to homogenous coordinates is 


Note: The Study Guide shows the student why the action of 
action of A on x. 


A 0 

0 r 1 


on the vector 


corresponds to the 


2. The matrix of the transformation is A = 


AD = 


-1 0 

0 1 


so the transformed data matrix is 


'-1 

o' 

“5 

2 

4 


"-5 

-2 

-4" 

0 

1 

0 

2 

3 


0 

2 

3_ 


Both the original triangle and the transformed triangle are shown in the following sketch. 



3. Following Examples 4-6, 


"V2/2 

-V2/2 0 ’ 

"1 0 

3' 


"V2/2 

-V 2/2 

y/2 

V2/2 

V 2/2 0 

0 1 

1 

= 

V2/2 

V 2/2 

2V2 

0 

0 1 

0 0 

1 


0 

0 

1 



'.8 

0 

0" 

r 1 

0 

-2 


'.8 


0 - 1 . 6 ' 



4. 

0 

1.2 

0 

0 

1 

3 

= 

0 

1.2 3.6 




0 

0 

1 

L° 

0 

1 


0 


0 1 




V3/2 

-1/2 

0 

'1 

0 

O' 


V3/2 

1/2 

0 

5. 


1/2 

y/3/2 

0 

0 - 

-1 

0 

= 

1/2 - 

-V3/2 

0 



0 


0 

1 

0 

0 

1 


0 

0 

1 


'1 

0 

ol 

’V 3/2 

- 1/2 

0 " 


\/3/2 

-1/2 

0 ’ 

6. 

0 

-1 

0 

1/2 

V 3/2 

0 

= 

-1/2 - 

-y/3/2 

0 


0 

0 

lj 


0 


0 

1 


0 

0 

1 
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7 . A 60° rotation about the origin is given in homogeneous coordinates by the matrix 
1/2 -y/3/2 0 " 


y/3/2 

0 


1/2 0 
0 1 


To rotate about the point (6, 8), first translate by (-6, -8), then rotate about the 


origin, then translate back by (6, 8) (see the Practice Problem in this section). A 60° rotation about (6, 8) 
is thus is given in homogeneous coordinates by the matrix 


‘1 0 6" 

1/2 -y/3/2 0 

“1 0 -6 


1/2 -y/3/2 3 + 4x/3 

0 1 8 

y/3/2 

1/2 0 

0 1 -8 

= 

y/3/2 1/2 4-3x/3 

0 0 1 

0 

0 1 

0 0 1 


0 0 1 


8. A 45° rotation about the origin is given in homogeneous coordinates by the matrix 


x/2/2 

x/2/2 

0 


-x/2/2 

x/2/2 

0 


0 

0 

1 


. To rotate about the point (3, 7), first translate by (-3, -7), then rotate about the 


origin, then translate back by (3, 7) (see the Practice Problem in this section). A 45° rotation about (3, 7) 
is thus is given in homogeneous coordinates by the matrix 


"1 0 3' 

"V2/2 

-x/2/2 0 " 

"1 0 

-3" 


"V2/2 

-x/2/2 

3 + 2V2 

0 1 7 

x/2/2 

x/ 2/2 0 

0 1 

-7 

= 

x/2/2 

x/2/2 

7-5x/2 

0 0 1 

0 

0 1 

0 0 

1 


0 

0 

1 


9 . To produce each entry in BD two multiplications are necessary. Since BD is a 2 x 200 matrix, it will take 
2 x 2 x 200 = 800 multiplications to compute BD. By the same reasoning it will take 2 x 2 x 200 = 800 
multiplications to compute A(BD). Thus to compute A(BD) from the beginning will take 800 + 800 = 
1600 multiplications. 

To compute the 2x2 matrix AB it will take 2 x 2 x 2 = 8 multiplications, and to compute ( AB)D it 
will take 2x2x200 = 800 multiplications. Thus to compute ( AB)D from the beginning will take 
8 + 800 = 808 multiplications. 

For computer graphics calculations that require applying multiple transformations to data matrices, 
it is thus more efficient to compute the product of the transformation matrices before applying the result 
to the data matrix. 


10 . Let the transformation matrices in homogeneous coordinates for the dilation, rotation, and translation be 
called respectively D, and R, and T. Then for some value of s, (p, h, and k. 



s 

0 

0" 


cos (p 

-sin (p 

0" 


"1 

0 

h 

D = 

0 

s 

0 

,R = 

sin^i 

cos (p 

0 

,T = 

0 

1 

k 


0 

0 

1 


0 

0 

1 


0 

0 

1 


Compute the products of these matrices: 


S COS (p 

—s sin (p 

0" 


S COS (p 

-s sin (p 

0‘ 

s sin (p 

s cos (p 

0 

,RD = 

s sin (p 

s cos (p 

0 

0 

0 

1 


0 

0 

1 


DR = 
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s 

0 

sh 


s 

0 

h 

0 

s 

sk 

11 

e 

0 

s 

k 

0 

0 

1 


0 

0 

1 



cos (p 

-sin (p 

h cos (p-k sin ^9 


cos (p 

-sin (p 

h 

RT = 

sin (p 

cos (p 

h sin (p + k cos (p 

, TR = 

sin (p 

cos (p 

k 


0 

0 

1 


0 

0 

1 


Since DR = RD, DT it TD and RT TR, D and R commute, D and T do not commute and R and T do not 
commute. 


11. To simplify A 2 A i completely, the following trigonometric identities will be needed: 
1. - tarup cos (p = - cos (p = - sirup 


2. sec (p- tan (p sirup = 


sin q> 
cos (p 


sinrp = 


l-sin 2 <p cos 2 (p 

cos tp cos tp 


= COS (p 


Using these identities, 



sec (p 

-tan (p 

0" 

1 

0 

0' 

^2 A — 

0 

1 

0 

sin (p 

cos (p 

0 


0 

0 

1 

0 

0 

1 


sec 99 -tan ^9 sin -tan^ccos^ 0 
sin (p cos (p 0 

0 0 1 


cos (p 
sin 99 
0 


-sin 9 ? 0 

cos (p 0 
0 1 


which is the transformation matrix in homogeneous coordinates for a rotation in E 2 . 


12 . To simplify this product completely, the following trigonometric identity will be needed: 

.. 1- cos ® sin® 

tan 99 / 2 = - = — 

sin (p 1 + cos^c 

This identity has two important consequences: 

, . .... . . , 1-cos® . 

l-(tan^>/2)(sm^>) = 1 sm (p = cos (p 

sin (p 

{cos cp)(- tan cp / 2)- tan cpl 2 = -(cos + l)tan^>/ 2 = -(cosff9 + l) sm ^ — - -sin (p 

1 + cos (p 

The product may be computed and simplified using these results: 


1 

-tan (pi 2 

0" 

1 

0 

0" 

"1 

-tan cp/ 2 

o' 


0 

1 

0 

sin (p 

1 

0 

0 

1 

0 


0 

0 

1 

0 

0 

1 

0 

0 

1 


"1 

-(tan^>/2)(sin^9) - 

tan 99 / 2 

0‘ 

f 1 -tanrpH 

0" 


sin (p 



1 


0 

0 1 


0 


0 



0 


1 

0 0 


1 



136 CHAPTER 2 • Matrix Algebra 


tarup / 2 

0" 

“1 

-tarup/ 2 

O' 

1 

0 

0 

1 

0 

0 

1 

0 

0 

1 


= sin^t 1 0 0 1 ( 

0 0 1 j[o 0 ] 

cos (p (cos^)(-tan^/2)-tan^>/2 0 

= sin (p -(sin^)(tan^/2) + 1 0 

0 0 1 

cos (p -sin (p 0 
= sin (p cos (p 0 


which is the transformation matrix in homogeneous coordinates for a rotation in 

13. Consider first applying the linear transformation on F 2 whose matrix is A, then applying a translation by 
the vector p to the result. The matrix representation in homogeneous coordinates of the linear 

r a oi 

transformation is , while the matrix representation in homogeneous coordinates of the 


1 P 

translation is „ . Applying these transi 

0 r lj 

representation in homogeneous coordinates is 
/ p A 0 A p 

0 r 1 0 r 1 _ O 7 ' 1 

which is the desired matrix. 


Applying these transformations in order leads to a transformation whose matrix 


14. The matrix for the transformation in Exercise 7 was found to be 
1/2 -V3/2 3 + 4V3 
x/3/2 1/2 4-3x/3 

0 0 1 


This matrix is of the form 



, where 


1/2 -V3/2] [3 + 4V3" 

A = r ,P = r 

yJ3/2 1/2J |_4-3x/3 

By Exercise 13, this matrix may be written as 

/ pir a 0 

o r 1 o r 1 

that is, the composition of a linear transformation on 1 2 and a translation. The matrix A is the matrix of a 
rotation about the origin in 3 2 . Thus the transformation in Exercise 7 is the composition of a rotation 

about the origin and a translation by p = 


3 + 4y/3~ 
4-3x/3 ' 
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15 . Since ( X , Y, Z, H) = ({,- j ,|,4j), the corresponding point in 3 has coordinates 
. (X Y Z\ ( \ -i _ 


(x,y,z)= — — — = =(12, -6, 3) 

V H ri M / Ttr 


24 24 24 


16 . The homogeneous coordinates (1, -2, 3, 4) represent the point 

(1/4, -2/4, 3/4) = (1/4, -1/2, 3/4) 

while the homogeneous coordinates (10, -20, 30, 40) represent the point 
(10/40,-20/40, 30/40) = (1/4, -1/2, 3/4) 
so the two sets of homogeneous coordinates represent the same point in 3 . 

17 . Follow Example 7a by first constructing that 3x3 matrix for this rotation. The vector ei is not changed 
by this rotation. The vector e 2 is rotated 60° toward the positive z-axis, ending up at the point (0, cos 60°, 
sin 60°) = (0, 1/2, -v/3/2). The vector e 3 is rotated 60° toward the negative y-axis, stopping at the point 
(0, cos 150°, sin 150°) = (0, -a/3/2, 1/2). The matrix A for this rotation is thus 

"10 0 
A= 0 1/2 —v/3/2 

0 y/3/2 1/2 

so in homogeneous coordinates the transformation is represented by the matrix 
“1 0 0 0 

A 01 0 1/2 ->/3/2 0 

0 7 lj 0 y/3/2 1/2 0 

0 0 0 1 

18 . First construct the 3x3 matrix for the rotation. The vector ej is rotated 30° toward the negative y-axis, 
ending up at the point (cos(-30)°, sin (-30)°, 0) = (-v/3/2, -1/2, 0). The vector e 2 is rotated 60° toward 
the positive x-axis, ending up at the point (cos 60°, sin 60°, 0) = (1/2, v3 /2, 0). The vector e 3 is not 
changed by the rotation. The matrix A for the rotation is thus 

"a/3/2 1/2 0 

A= -1/2 y/3/2 0 

0 0 1 

so in homogeneous coordinates the rotation is represented by the matrix 
~ y/3/2 1/2 0 0 

A °]= ~ 1/2 ^ /2 0 0 

o 7 1 J 0 0 10 

0 0 0 1 

Following Example 7b, in homogeneous coordinates the translation by the vector (5, -2, 1) is represented 
by the matrix 

"1 0 0 5" 

0 10-2 
0 0 1 1 

0 0 0 1 
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Thus the complete transformation is represented in homogeneous coordinates by the matrix 


"1 

0 

0 

5" 

"x/3/2 

1/2 

0 

o" 


"x/3/2 

1/2 

0 

5 

0 

1 

0 

-2 

-1/2 

x/3/2 

0 

0 


-1/2 

y/3/2 

0 

-2 

0 

0 

1 

1 

0 

0 

1 

0 


0 

0 

1 

1 

0 

0 

0 

1 

0 

0 

0 

1 


0 

0 

0 

1 


19 . Referring to the material preceding Example 8 in the text, we find that the matrix P that performs a 
perspective projection with center of projection (0, 0, 10) is 

"1 0 0 0 " 

0 1 0 0 

0 0 0 0 

0 0 -.1 1 

The homogeneous coordinates of the vertices of the triangle may be written as (4.2, 1.2, 4, 1), (6, 4, 2, 1), 
and (2, 2, 6, 1), so the data matrix for S is 

"4.2 6 2" 

1.2 4 2 

4 2 6 

1 1 1 

and the data matrix for the transformed triangle is 


"1 

0 

0 

0" 

"4.2 

6 

2" 


"4.2 

6 

2" 

0 

1 

0 

0 

1.2 

4 

2 


1.2 

4 

2 

0 

0 

0 

0 

4 

2 

6 


0 

0 

0 

0 

0 

-.1 

1 

1 

1 

1 


.6 

.8 

.4 


Finally, the columns of this matrix may be converted from homogeneous coordinates by dividing by the 
final coordinate: 

(4.2, 1.2, 0, .6) — > (4.2/. 6, 1.2/.6, 0/.6) = (7, 2, 0) 

(6, 4, 0, .8) — > (6/. 8, 2/. 8, 0/.8) = (7.5, 5, 0) 

(2, 2, 0, .4) -A (2/. 4, 2/. 4, 0/.4) = (5, 5, 0) 

So the coordinates of the vertices of the transformed triangle are (7, 2, 0), (7.5, 5, 0), and (5, 5, 0). 

20 . As in the previous exercise, the matrix P that performs the perspective projection is 
"1 0 0 0 " 

0 1 0 0 

0 0 0 0 

0 0 -.1 1 

The homogeneous coordinates of the vertices of the triangle may be written as (9, 3, -5, 1), (12, 8, 2, 1), 
and (1.8, 2.7, 1, 1), so the data matrix for S is 

' 9 12 1.8" 

3 8 2.7 

-5 2 1 

1 1 1 
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and the data matrix for the transformed triangle is 


"1 

0 

0 

0 " 

" 9 

12 

1.8" 


9 

12 

1.8" 

0 

1 

0 

0 

3 

8 

2.7 


3 

8 

2.7 

0 

0 

0 

0 

-5 

2 

1 


0 

0 

0 

0 

0 

-.1 

1 

1 

1 

1 


1.5 

.8 

.9 


Finally, the columns of this matrix may be converted from homogeneous coordinates by dividing by the 
final coordinate: 

(9, 3, 0, 1.5) — > (9/1.5, 3/1.5, 0/1.5) = (6, 2, 0) 

(12, 8, 0, .8) -> (12/. 8, 8/. 8, 0/.8) = (15, 10, 0) 

(1.8, 2.7, 0, .9) -> (1.8/. 9, 2.7/. 9, 0/.9) = (2, 3, 0) 

So the coordinates of the vertices of the transformed triangle are (6, 2, 0), (15, 10, 0), and (2, 3, 0). 


21. [M] Solve the given equation for the vector ( R , G, B), giving 


R 


'.61 

.29 

.15" 

-1 

X 


' 2.2586 

-1.0395 

-.3473" 

"X 

G 

= 

.35 

.59 

.063 


Y 

= 

-1.3495 

2.3441 

.0696 

Y 

B 


.04 

.12 

.787 


Z 


.0910 

-.3046 

1.2777 

Z 


22. [M] Solve the given equation for the vector ( R , G, B), giving 


R 


'.299 

.587 

.114" 

-1 

Y 


"1.0031 

.9548 

.6179" 

"7 

G 

= 

.596 

-.275 

-.321 


I 

= 

.9968 

-.2707 

-.6448 

/ 

B 


.212 

-.528 

.311 


_Q_ 


1.0085 

-1.1105 

1.6996 

_Q 


2.8 SOLUTIONS 

Notes: Cover this section only if you plan to skip most or all of Chapter 4. This section and the next cover 
everything you need from Sections 4. 1-4.6 to discuss the topics in Section 4.9 and Chapters 5-7 (except for 
the general inner product spaces in Sections 6.7 and 6.8). Students may use Section 4.2 for review, particu- 
larly the Table near the end of the section. (The final subsection on linear transformations should be omitted.) 
Example 6 and the associated exercises are critical for work with eigenspaces in Chapters 5 and 7. Exercises 
31-36 review the Invertible Matrix Theorem. New statements will be added to this theorem in Section 2.9. 

Key Exercises: 5-20 and 23-26. 

1. The set is closed under sums but not under multiplication 
by a negative scalar. A counterexample to the subspace 
condition is shown at the right. 



Note: Most students prefer to give a geometric counterexample, but some may choose an algebraic calcu- 
lation. The four exercises here should help students develop an understanding of subspaces, but they may be 
insufficient if you want students to be able to analyze an unfamiliar set on an exam. Developing that skill 
seems more appropriate for classes covering Sections 4. 1-4.6. 
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2 . The set is closed under scalar multiples but not sums. 
For example, the sum of the vectors u and v shown 
here is not in H. 


3 . No. The set is not closed under sums or scalar multiples. The subset 
consisting of the points on the line x 2 = x\ is a subspace, so any 
“counterexample” must use at least one point not on this line. 

Flere are two counterexamples to the subspace conditions: 



4. No. The set is closed under sums, but not under multiplication by a 
negative scalar. 



5 . The vector w is in the subspace generated by Vi and v 2 if and only if the vector equation jqvi + x 2 v 2 = w 
is consistent. The row operations below show that w is not in the subspace generated by Vi and v 2 . 


[v, v 2 w]~ 

“2-4 8" 

3-5 2 

, , 

1 

00 O 

7 

1 

<N O 

1 

, 

'(2) -4 8" 

0 (D -10 


-5 8 -9 


0-2 11 


O 

O 

1 


6. The vector u is in the subspace generated by {vi, v 2 , V3} if and only if the vector equation jtiVi + x 2 v 2 + 
X3V3 = u is consistent. The row operations below show that u is not in the subspace generated by 
{vi, v 2 , v 3 }. 


1 

4 

5 

-4 


1 

4 

5 

-4" 



4 

5 

-4' 

-2 

-7 

-8 

10 


0 

1 

2 

2 


0 


2 

2 

4 

9 

6 

-7 


0 

-7 

-14 

9 


0 

0 

0 

© 

3 

7 

5 

-5_ 


0 

-5 

-10 

7_ 


0 

0 

0 

!7_ 


Note: For a quiz, you could use w = (1,-3, 11, 8), which is in Span{v 1? v 2 , v 3 }. 

7. a. There are three vectors: Vi, v 2 , and v 3 in the set {vi, v 2 , v 3 }. 

b. There are infinitely many vectors in Span{vi, v 2 , V3} = Col A. 

c. Deciding whether p is in Col A requires calculation: 


[A p]~ 

“ 2 
-8 

-3 

8 

-4 

6 

6 

-10 


'2 

0 

-3 

-4 

-4 

-10 

6 

14 

( , 

© 

0 

-3 

0 

-4 

-10 

6“ 

14 


6 

-7 

-7 

11 


0 

2 

5 

-7 


0 

0 

0 

0 


The equation Ax = p has a solution, so p is in Col A. 
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8. [A p] = 

"-3 

0 

-2 

2 

0 

-6 

f 

14 


'-3 

0 

-2 

2 

0 

-6 

f 

14 

, 

r© 

0 

-2 

© 

0 

-6 

f 

14 


6 

3 

3 

-9 


0 

-1 

3 

-7 


0 

0 

0 

0 


Yes, the augmented matrix [A p] corresponds to a consistent system, so p is in Col A. 

9. To determine whether p is in Nul A, simply compute Ap. Using A and p as in Exercise 7, 


Ap = 

1 

■St 

1 

cn oo 
1 

(N OO 
1 

1 

6" 

-10 

— 

XT 

K> K> 

i 

. Since ^4p ^ 0, p is not in Nul A 


1 

1 

11 


29 



10. To determine whether u is in Nul A, simply compute Au. Using A as in Exercise 7 and u = (-2, 3,1), 


Au = 

'-3 

0 

-2 

2 

0" 

-6 

“-2“ 

3 



“ 0 “ 

0 

. Yes, u is in Nul A 


6 

3 

3 

1 


0 



11. p = 4 and q = 3. Nul A is a subspace of R 4 because solutions of Ax = 0 must have 4 entries, to match the 
columns of A. Col A is a subspace of R 3 because each column vector has 3 entries. 

12. p = 3 and q = 4. Nul A is a subspace of R 3 because solutions of Ax = 0 must have 3 entries, to match the 
columns of A. Col A is a subspace of R 4 because each column vector has 4 entries. 

13. To produce a vector in Col A, select any column of A. For Nul A, solve the equation Ax = 0. (Include an 
augmented column of zeros, to avoid errors.) 



3 

2 

1 

-5 

0" 


“3 

2 

i 

-5 

0" 


"3 2 1 

-5 0] 

- 

-9 

-4 

1 

7 

0 

~ 

0 

2 

4 

-8 

0 

~ 

0 2 4 

O 

OO 

1 


9 

2 

-5 

1 

0 


0 

-4 

-8 

16 

0 


0 0 0 

o ' 
o 


"3 

2 

1 

-5 

0" 


CD 

0 

-1 

1 

0" 


© ~ x 3 

II 

K 

+ 

~ 

0 

1 

2 

-4 

0 

~ 

0 

CD 

2 

-4 

0 

5 

©+ 2*3 

II 

■'4- 

H 

1 


0 

0 

0 

0 

0 


0 

0 

0 

0 

0 



0 = 


The general solution is x\ = x 3 - x 4 , and x 2 = -2x 3 + 4x 4 , with x 3 and x 4 free. The general solution in 
parametric vector form is not needed. All that is required here is one nonzero vector. So choose any 
values for x 3 andx 4 (not both zero). For instance, setx 3 = 1 andx 4 = 0 to obtain the vector (1, -2, 1, 0) in 
Nul A. 

Note: Section 2.8 of Study Guide introduces the ref command (or rref , depending on the technology), 
which produces the reduced echelon form of a matrix. This will greatly speed up homework for students who 
have a matrix program available. 

14. To produce a vector in Col A, select any column of A. For Nul A, solve the equation Ax = 0: 


1 

2 

3 

0“ 


“1 

2 

3 

0“ 


“1 

2 

3 

0“ 


■0 

0 

-1/3 

o' 

4 

5 

7 

0 


0 

-3 

-5 

0 


0 

1 

5/3 

0 


0 

© 

5/3 

0 

-5 

-1 

0 

0 


0 

9 

15 

0 


0 

0 

0 

0 


0 

0 

0 

0 

2 

7 

11 

0 


0 

3 

5 

0 


0 

0 

0 

0 


0 

0 

0 

0 


The general solution is x t = (1/3 )x 3 and x 2 = (-5/3) x 3 , with x 3 free. The general solution in parametric 
vector form is not needed. All that is required here is one nonzero vector. So choose any values of x 3 and 
x 4 (not both zero). For instance, set x 3 = 3 to obtain the vector (1, -5, 3) in Nul A. 
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15. Yes. Let A be the matrix whose columns are the vectors given. Then A is invertible because its 
determinant is nonzero, and so its columns form a basis for R 2 , by the Invertible Matrix Theorem (or by 
Example 5). (Other reasons for the invertibility of A could be given.) 

16. No. One vector is a multiple of the other, so they are linearly dependent and hence cannot be a basis for 
any subspace. 

17. No. Place the three vectors into a 3x3 matrix A and determine whether A is invertible: 

" 0 5 6] r 1 -7 3] r 1 -7 3] [® -7 3" 

A= 1 -7 3 - 0 5 6-0 5 6 ~ 0 (D 6 

-2 4 5j [—2 4 5 J |_0 -10 llj [O 0 (23) 

The matrix A has three pivots, so A is invertible by the IMT and its columns form a basis for R 3 (as 
pointed out in Example 5). 

18. Yes. Place the three vectors into a 3x3 matrix A and determine whether A is invertible: 

“1-5 7] r 1 -5 7] [® -5 7“ 

A= 1-1 0-0 4-7-0® -7 

-2 2 - 5 J |_0 -8 9j |_0 0 

The matrix A has three pivots, so A is invertible by the IMT and its columns form a basis for R 3 (as 
pointed out in Example 5). 

19. No. The vectors cannot be a basis for R 3 because they only span a plan in R 3 . Or, point out that the 

1 _5 1 

columns of the matrix 1 -1 cannot possibly span R 3 because the matrix cannot have a pivot in 

-2 2 

every row. So the columns are not a basis for R 3 . 

Note: The Study Guide warns students not to say that the two vectors here are a basis for R 2 . 

20. No. The vectors are linearly dependent because there are more vectors in the set than entries in each 
vector. (Theorem 8 in Section 1.7.) So the vectors cannot be a basis for any subspace. 

21. a. False. See the definition at the beginning of the section. The critical phrases “for each” are missing. 

b. True. See the paragraph before Example 4. 

c. False. See Theorem 12. The null space is a subspace of R", not R'". 

d. True. See Example 5. 

e. True. See the first part of the solution of Example 8. 

22. a. False. See the definition at the beginning of the section. The condition about the zero vector is only 

one of the conditions for a subspace. 

b. True. See Example 3. 

c. True. See Theorem 12. 

d. False. See the paragraph after Example 4. 

e. False. See the Warning that follows Theorem 13. 
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23 . 


(Solution in Study Guide ) A = 

1 

Os 4^ 

9 -2' 

1 12 


® 2 6-5' 

0 (!) 5 -6 

. The echelon form identifies 


3 4 

8 -3 


0 0 0 0 



columns 1 and 2 as the pivot columns. A basis for Col A uses columns 1 and 2 of A: 



. This is not 


the only choice, but it is the “standard” choice. A wrong choice is to select columns 1 and 2 of the 
echelon form. These columns have zero in the third entry and could not possibly generate the columns 
displayed in A. 


24 . 


For Nul A, obtain the reduced (and augmented) echelon form for Ax = 0 : 


'® 0 -4 7 

0 CD 5 -6 

0 0 0 0 


0 

0 

0 


. This corresponds to: 


- 4x 3 + 7x 4 = 0 
( xj ) + 5x 3 - 6x 4 = 0 . 

0 = 0 


Solve for the basic variables and write the solution of Ax = 0 in parametric vector form: 


. Basis for Nul A: 


*1 


4x 3 -7x 4 


" 4' 


'-7~ 

*2 


-5x 3 + 6x4 

= x 3 

-5 

1 

+ x 4 

6 

0 

x 3 


x 3 


_x 4 _ 


x 4 


0 


1 


' 4 


'-7' 

-5 


6 

1 

9 

0 

0 


1 


Notes: (1) A basis is a set of vectors. For simplicity, the answers here and in the text list the vectors without 
enclosing the list inside set brackets. This style is also easier for students. I am careful, however, to 
distinguish between a matrix and the set or list whose elements are the columns of the matrix. 

(2) Recall from Chapter 1 that students are encouraged to use the augmented matrix when solving Ax = 0 , 
to avoid the common error of misinterpreting the reduced echelon form of A as itself the augmented matrix 
for a nonhomogeneous system. 

(3) Because the concept of a basis is just being introduced, 1 insist that my students write the parametric 
vector form of the solution of Ax = 0 . They see how the basis vectors span the solution space and are 
obviously linearly independent. A shortcut, which some instructors might introduce later in the course, is only 
to solve for the basic variables and to produce each basis vector one at a time. Namely, set all free variables 
equal to zero except for one free variable, and set that variable equal to a suitable nonzero number. 


'-3 9 -2 -7' 


"® -3 6 9" 


'-3' 


'-2' 

2-648 

~ 

0 0 © 5 

. Basis for Col A: 

2 

9 

4 

1 

1 

SO 

1 

to 

to 

1 


0 0 0 0 


3 


-2 


For Nul A, obtain the reduced (and augmented) echelon form for Ax = 0 : 


© 

-3 

0 

1.50 

O' 

©" 

3x 2 + 1.50x 4 = 0 

0 

0 

© 

1.25 

0 

. This corresponds to: 

(xS + 1.25x 4 = 0 

0 

0 

0 

0 

0 


0 = 0 


Solve for the basic variables and write the solution of Ax = 0 in parametric vector form: 


Xi 


3x 2 -1.5x 4 


"3" 


" -1.5 

*2 

= 

*2 

= x 2 

1 

+ x 4 

0 

x 3 


-1.25x 4 


0 


-1.25 

x 4 


x 4 


0 


1 


" 3' 


'-1.5 " 

1 


0 

0 

9 

-1.25 

0 


1 


. Basis for Nul A: 
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1 4 8-3-7 

-1 2 7 3 4 

-2 2 9 5 5 

3 6 9 -5 -2 


U) 4 8 0 5 

0 (2) 5 0-1 

0 0 0 ®4 

0 0 0 0 0 


. Basis for Col A: 


For Nul A, obtain the reduced (and augmented) echelon form for Ax = 0: 

'0 0 -2 0 7 0 ] @ - 2x 3 + ' 

0 0 2.5 0 -.5 0 (xZ) + 2.5x-, - 

[A 0]~ W ^ 3 

0 0 0 0 4 0 (xA+ * 


0 0 


4 0 


0 0 0 0 0 0 


- 2x 3 

i + 2.5 x-. 


+ lx 5 = 
- .5xc = 


Xa) + 4x 5 


2x 3 - 7x 5 
— 2.5x 3 + .5x 5 


The solution of Ax = 0 in parametric vector form : x. = 


1 \ + X: 


Basis for NuM: {u, v}. 

Note: The solution above illustrates how students could write a solution on an exam, when time is precious, 
namely, describe the basis by giving names to appropriate vectors found in the calculations. 


26. A = \ 


3-173 
-2 2-2 7 


3 3 


3 7 


-1 7 


0 3 


0 0 0 0 1 
0 0 0 0 0 


Basis for Col A: 


-n r 3 


For NuU, 


U 0]' 


0 0 3 0 2.5 0 _ 

0 0 2 0 1.5 0 

0 0 0 0 1 0 


0 0 0 0 


+ 2.5x 5 = 
+ 1.5x 5 = 


The solution of ^4x = 0 in parametric vector form: 


-3x 3 - 2.5x 5 
-2 x 3 — 1 ,5x 5 


= x 3 1 + x 5 


-1 . Basis for Nul A: {u, v}. 


27. Construct a nonzero 3><3 matrix A and construct b to be almost any convenient linear combination of the 
columns of^4. 
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28 . 

29 . 


30 . 


31 . 


32 . 


33 . 


34 . 


35 . 

36 . 


37 . 


The easiest construction is to write a 3><3 matrix in echelon form that has only 2 pivots, and let b be any 
vector in R whose third entry is nonzero. 

(Solution in Study Guide ) A simple construction is to write any nonzero 3x3 matrix whose columns are 
obviously linearly dependent, and then make b a vector of weights from a linear dependence relation 
among the columns. For instance, if the first two columns of A are equal, then b could be (1, -1, 0). 

Since Col A is the set of all linear combinations of a 1? . . . , a p , the set {ai, . . . , a /; } spans Col A. Because 
{a 1? ... , A p ) is also linearly independent, it is a basis for Col .4. (There is no need to discuss pivot 
columns and Theorem 13, though a proof could be given using this information.) 

If Col F ^ R 5 , then the columns of F do not span R 5 . Since F is square, the 1MT shows that F is not 
invertible and the equation Fx = 0 has a nontrivial solution. That is, Nul F contains a nonzero vector. 
Another way to describe this is to write Nul F ^ { 0 }. 

If Nul R contains nonzero vectors, then the equation Rx = 0 has nontrivial solutions. Since R is square, 
the 1MT shows that R is not invertible and the columns of R do not span R 6 . So Col R is a subspace of 
R 6 , but Col R * R 6 . 

If Col Q = R 4 , then the columns of Q span R 4 . Since Q is square, the IMT shows that Q is invertible and 
the equation Qx = b has a solution for each b in R 4 . Also, each solution is unique, by Theorem 5 in 
Section 2.2. 


If Nul P = { 0 }, then the equation Px 0 has only the trivial solution. Since P is square, the IMT shows 
that P is invertible and the equation Px b has a solution for each b in R 5 . Also, each solution is unique, 
by Theorem 5 in Section 2.2. 

If the columns of B are linearly independent, then the equation Bx = 0 has only the trivial (zero) solution. 
That is, Nul B = { 0 }. 


If the columns of A form a basis, they are linearly independent. This means that A cannot have more 
columns than rows. Since the columns also span R"', A must have a pivot in each row, which means that 
A cannot have more rows than columns. As a result, A must be a square matrix. 


[M] Use the command that produces the reduced echelon form in one step (ref or rref depending 
on the program). See the Section 2.8 in the Study Guide for details. By Theorem 13, the pivot columns of 
A form a basis for Col A. 


3 

-5 

0 

-1 

3“ 



0 

2.5 

-7 

9 

-4 

9 

-11 


0 

® 

1.5 

-5 

7 

-2 

5 

-7 


0 

0 

0 

3 

-7 

-3 

4 

0 


0 

0 

0 


-4.5 

3.5' 


3' 


'-5' 

-2.5 

1.5 

Basis for Col A: 

-7 


9 

0 

0 


-5 


7 

0 

0 


3 


-7 


For Nul A, obtain the solution of Ax = 0 in parametric vector form: 



4.5x 4 + 3.5x 5 = 0 
2.5x 4 + 1.5x 5 = 0 


[ jq = -2.5 x 3 + 4.5x 4 - 3.5x 5 
x 2 = — 1.5jc 3 + 2.5x 4 - 1.5x 5 
x 3 ,x 4 , and x 5 are free 


Solution: < 
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*1 


-2.5x 3 +4.5 x 4 -3.5x 5 


'-2.5' 


"4.5' 


'-3.5' 

x 2 


— 1 ,5x 3 +2.5x 4 — 1 .5x 5 


-1.5 


2.5 


-1.5 

x 3 

= 

x 3 

= x 3 

1 

+ x 4 

0 

+ x 5 

0 

x 4 


x 4 


0 


1 


0 

*s_ 


X 5 


0 


0 


1 


By the argument in Example 6, a basis for Nul A is {u, v, w} . 


= JC 3 U + X 4 V + X 5 W 


38. 


[M] A = 


5 

2 

0 

-8 

-8" 


© 

0 

0 

60 

122" 

4 

1 

2 

-8 

-9 


0 

© 

0 

-154 

-309 

5 

1 

3 

5 

19 


0 

0 

© 

-47 

-94 

-8 

-5 

6 

8 

5_ 


0 

0 

0 

0 

0 



For Nul A, solve Ax = 0: (xj) - 154x 4 - 309x 5 = 0 

( x ^) - 47x 4 - 94x 5 = 0 


Solution: ■=! 


JCj = -60x 4 - 122x 5 
x 2 = 154x 4 + 309x 5 
x 3 = 47 x 4 + 94x 5 
x 4 and x 5 are free 


x 1 


-60x 4 -122x 5 


■-60" 


"—122" 

*2 


154x 4 +309x 5 


154 


309 

x 3 

= 

47x 4 + 94x 5 

= x 4 

47 

+ x 5 

94 

x 4 


x 4 


1 


0 



X 5 


_ 0 


1 


= X4I1 + X5V 


By the method of Example 6, a basis for Nul A is {u, v} 


Note: The Study Guide for Section 2.8 gives directions for students to construct a review sheet for the 
concept of a subspace and the two main types of subspaces, Col A and Nul A, and a review sheet for the 
concept of a basis. 1 encourage you to consider making this an assignment for your class. 


2.9 SOLUTIONS 

Notes: This section contains the ideas from Sections 4.4-4. 6 that are needed for later work in Chapters 5-7. 
If you have time, you can enrich the geometric content of “coordinate systems” by discussing crystal lattices 
(Example 3 and Exercises 35 and 36 in Section 4.4.) Some students might profit from reading Examples 1-3 
from Section 4.4 and Examples 2, 4, and 5 from Section 4.6. Section 4.5 is probably not a good reference for 
students who have not considered general vector spaces. 

Coordinate vectors are important mainly to give an intuitive and geometric feeling for the isomoiphism 
between a ^--dimensional subspace and R A . If you plan to omit Sections 5.4, 5.6, 5.7 and 7.2, you can safely 
omit Exercises 1-8 here. 
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Exercises 1-16 may be assigned after students have read as far as Example 2. Exercises 19 and 20 use the 
Ra nk Theorem, but they can also be assigned before the Ra nk Theorem is discussed. 

The Rank Theorem in this section omits the nontrivial fact about Row A which is included in the Rank 
Theorem of Section 4.6, but that is used only in Section 7.4. The row space itself can be introduced in Section 
6.2, for use in Chapter 6 and Section 7.4. 

Exercises 9-16 include important review of techniques taught in Section 2.8 (and in Sections 1.2 and 2.5). 
They make good test questions because they require little arithmetic. My students need the practice here. 
Nearly every time I teach the course and start Chapter 5, 1 find that at least one or two students cannot find a 
basis for a two-dimensional eigenspace! 


1. If[x] B = 


, then x is formed from b i and b2 using 


weights 3 and 2: 



1 


2 


7 

x = 3bi + 2b 2 = 3 

1 

+ 2 

-1 

— 

1 



2. If[x] B = 



, then x is 


formed from bi and b 2 using weights -1 and 3: 



3 . To find ci and C2 that satisfy x = cqbi + C2b2, row reduce the augmented matrix: 

r i — 2 — 3 i r i -2 - 3 i r i o 71 

[b. b 2 xl = ~ ~ . Or, one can write a matrix equation as 

L -4 7 7 J L° -1 _5 J L° 1 5 J 

suggested by Exercise 7 and solve using the matrix inverse. In either case, 

M B 


1 

1 


'7' 

_ C 2_ 


1 

1 


4 . As in Exercise 3, [b, b 2 


1 -3 

-7' 


"1 

-3 

-1 


"1 

0 5' 

-3 5 

5_ 


0 

-4 

-16 


0 

1 4 _ 


, and 



1 

-3 

4 


"1 

-3 

4 


"1 

0 

1/4" 

















C, 


1/4" 

5 

-7 

10 


0 

8 

-10 


0 

1 

-5/4 

•[X] B = 

1 

c 2 

— 

-5/4 

-3 

5 

-7 


0 

-4 

5 


0 

0 

0 






5 . [b, b 2 x] — 
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6. [b, b 2 x] — 


Ws = 


"-3 

7 

If 


"1 

5 

0" 


"1 

0 

-5/2" 

1 

5 

0 

~ 

0 

22 

11 

~ 

0 

1 

1/2 

-4 

-6 

7 


0 

14 

7 


0 

0 

0 


Cl 


"-5/2" 

_ C 2_ 


1/2 _ 


7. Fig. 1 suggests that w = 2b, - b 2 and x = 1.5bi + .5b2, in which case, 


[w] £ 


2 

-1 


and [x] e = 


1.5 

.5 


. To confirm [x] e , compute 


1.5b, +.5b 2 =1.5 


+ .5 


-i 

2 


= x 




Note: Figures 1 and 2 display what Section 4.4 calls 5-graph paper. 


8. Fig. 2 suggests that x = 2bj - b 2 , y = 1.5bi + b 2 , and z = -b, - .5b2. If so, then 


Mf 


2 

-1 


[y]e = 


1.5 

1.0 


and [z] B = 


-1 

-.5 


To confirm [y] s and [z] B , compute 


1.5b, +b 2 =1.5 


0 


2 


2 


+ 


= 


2 


1 


4 


= y and -b, -.5b 2 =-l 


-.5 


-1 

-2.5 


= z 


9. The information A = 


1 -3 

2 

-4 


® 

-3 

2 -4" 

-3 9 

-1 

5 


0 

0 

© -7 

2 -6 

4 

-3 


0 

0 

0 © 

-4 12 

2 

7_ 


0 

0 

0 0 


is enough to see that columns 1, 3, and 4 of 


A form a basis for Col A: 


1 

-3 

2 

-4 


2 

-1 

4 

2 


-4 

5 

-3 

7 


Columns 1, 2 and 4, of the echelon form certain cannot span Col A since those vectors all have zero in 
their fourth entries. For Nul A, use the reduced echelon form, augmented with a zero column to insure 
that the equation Ax = 0 is kept in mind: 
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© -3 0 0 0 ©)- 3x 2 =0 3x 2 3 3 

0 0 © 0 0 @ = 0 x 2 x 2 1 1 

o o o © o ‘ @ = o ’ x_ x 3 _ o _X 2 o‘ So o ls 

0 0 0 0 0 x 2 is the free variable _x 4 0 0 0 

a basis for Nul A. From this information, dim Col A = 3 (because A has three pivot columns) and dim Nul 
A = 1 (because the equation Ax = 0 has only one free variable). 


1 -2 


10. The information A = 


1 -1 


0-6 1-2 


4] [CD -2 9 5 4' 

-3 0 © -3 0 -7 

-2 ~ 0 0 0 © -2 


n r-2 


1 -9 0 0 0 0 


shows that columns 1, 2, 


and 4 of A form a basis for Col A: 


1-1 


or i 


For Nul 


U 0 ]' 


© 0 3 0 0 0" 

0 © -3 0-7 0 

0 0 0 © -2 0 

0 0 0 0 0 0 


- lx 5 = 0 

i - 2x> = 0 


x 3 and x 5 are free variables 


3x 3 + 7x 5 


From this, dim Col A = 3 and dim Nul A = 2. 


3 7 


1 +x 5 0 . Basis for NuM: 1 


11 . The information A = \ 


0 -ll [©2-5 0 -1" 

4 3 0 © 2 4 5 


-3 -9 9 -7 -2 

3 10 -7 11 7 


0 0 0 © 

0 0 0 0 


shows that columns 1, 2, 


and 4 of A form a basis for Col A: 


-3 -9 -7 


. For Nul 


M o]. 


0 0 


0 0 0 0 0 0 


© 0 -9 0 5 0] © 

0 © 2 0-3 0 

0 0 0 © 2 0 ■ 


+ 5x 5 = 0 
- 3x 5 = 0 

I + 2x 5 = 0 


x 3 and x 5 are free variables 
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X = 


*1 


1 

X 

U 1 

1 

* 


" 9" 


'-5' 


" 9" 


" -5' 

*2 


-2x 3 + 3 x 5 


-2 


3 


-2 


3 

x 3 

= 

x 3 

= x 3 

1 

+ *5 

0 

. Basis for Nul 0: 

1 

9 

0 

x 4 


-2*5 


0 


-2 


0 


-2 

X 5 _ 


*5 


0 


1 


0 


1 


From this, dim Col A = 3 and dim Nul A = 2. 


12 . The information A = 


1 

2 

-4 

3 

3" 


© 

2 

-4 

3 

3' 

5 

10 

-9 

-7 

8 


0 

0 

© 

-2 

0 

4 

8 

-9 

-2 

7 


0 

0 

0 

0 

© 

-2 

-4 

5 

0 

-6 


0 

0 

0 

0 

0 


shows that columns 1, 3, 


and 5 of A form a basis for Col A: 


f 


1 

1 


1 

5 


-9 


8 

4 

9 

-9 

9 

7 

<N 

1 

1 


1 


-6 


For Nul A 


[A 0 ]. 


© 

0 

0 

0 


0 -5 
© -2 
0 
0 


0 0 
0 0 
0 © 0 
0 0 0 


+ 2x 2 


- 5x 4 

- 2x 4 


= 0 
= 0 


©)= 0 


x 2 and x 4 are free variables 


*i 


— 2 x 2 + 5x 4 


'-2' 


' 5' 


'-2' 


' 5' 

*2 


*2 


1 


0 


1 


0 

*3 

= 

2x 4 

= *2 

0 

+ * 4 

2 

. Basis for NuU: 

0 

9 

2 

*4 


* 4 


0 


1 


0 


1 

X 5 _ 


0 


0 


0 


0 


0 


From this, dim Col A = 3 and dim Nul A = 2. 


13 . The four vectors span the column space H of a matrix that can be reduced to echelon form: 


1 

-3 

2 

-4 


"1 

-3 

2 

-4' 


“1 

-3 

2 

-4' 


© 

-3 

2 

-4' 

-3 

9 

-1 

5 


0 

0 

5 

-7 


0 

0 

5 

-7 


0 

0 

© 

-7 

2 

-6 

4 

-3 


0 

0 

0 

5 


0 

0 

0 

5 


0 

0 

0 

© 

-4 

12 

2 

7_ 


0 

0 

10 

-9 


0 

0 

0 

5_ 


0 

0 

0 

0 


Columns 1,3, and 4 of the original matrix form a basis for H, so dim H = 3. 


Note: Either Exercise 13 or 14 should be assigned because there are always one or two students who confuse 
Col A with Nul A. Or, they wrongly connect “set of linear combinations” with “parametric vector form” (of 
the general solution of /lx = 0). 


14 . The five vectors span the column space H of a matrix that can be reduced to echelon form: 


1 

2 

0 

-1 

3“ 


“1 

2 

0 

-1 

3" 


© 

2 

0 

-1 

3' 

-1 

-3 

2 

4 

-8 


0 

-1 

2 

3 

-5 


0 

0 

2 

3 

-5 

-2 

-1 

-6 

-7 

9 


0 

3 

-6 

-9 

15 


0 

0 

0 

0 

0 

5 

6 

8 

7 

-5_ 


0 

-4 

8 

12 

-20_ 


0 

0 

0 

0 

0 


Columns 1 and 2 of the original matrix form a basis for H, so dim H= 2. 
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15. Col A = R 3 , because A has a pivot in each row and so the columns of A span R 3 . Nul A cannot equal R 2 , 
because Nul A is a subspace of R 5 . It is true, however, that Nul A is two-dimensional. Reason: the 
equation Ax = 0 has two free variables, because A has five columns and only three of them are pivot 
columns. 

16. Col A cannot be R 3 because the columns of A have four entries. (In fact, Col A is a 3-dimensional 
subspace of R 4 , because the 3 pivot columns of A form a basis for Col A.) Since A has 7 columns and 
3 pivot columns, the equation Ax = 0 has 4 free variables. So, dim Nul A = 4. 

17. a. True. This is the definition of a R-coordinate vector. 

b. False. Dimension is defined only for a subspace. A line must be through the origin in R" to be a 
subspace of R". 

c. True. The sentence before Example 1 concludes that the number of pivot columns of A is the ra nk of 
A, which is the dimension of Col A by definition. 

d. True. This is equivalent to the Ra nk Theorem because rank A is the dimension of Col A. 

e. True, by the Basis Theorem. In this case, the spanning set is automatically a linearly independent set. 

18. a. True. This fact is justified in the second paragraph of this section. 

b. True. See the second paragraph after Fig. 1. 

c. False. The dimension of Nul A is the number of free variables in the equation Ax = 0. 

See Example 2. 

d. True, by the definition of rank. 

e. True, by the Basis Theorem. In this case, the linearly independent set is automatically a spanning set. 

19. The fact that the solution space of Ax = 0 has a basis of three vectors means that dim Nul A = 3. Since a 
5x7 matrix A has 7 columns, the Ra nk Theorem shows that ra nk A = 1 - dim Nul A - 4. 

Note: One can solve Exercises 19-22 without explicit reference to the Ra nk Theorem. For instance, in 
Exercise 19, if the null space of a matrix A is three-dimensional, then the equation Ax = 0 has three free 
variables, and three of the columns of A are nonpivot columns. Since a 5x7 matrix has seven columns, A must 
have four pivot columns (which form a basis of Col A). So rank A = dim Col A = 4. 

20. A 4 x 5 matrix A has 5 columns. By the Ra nk Theorem, rank A = 5 - dim Nul A. Since the null space is 
three-dimensional, ra nk A = 2. 

21. A 7x6 matrix has 6 columns. By the Ra nk Theorem, dim Nul A = 6 - rank A. Since the ra nk is four, dim 
Nul A = 2. That is, the dimension of the solution space of Ax = 0 is two. 

22. The wording of this problem was poor in the first printing, because the phrase “it spans a four- 
dimensional subspace” was never defined. Here is a revision that I will put in later printings of the third 
edition: 

Show that a set {vi, . . ., V 5 } in R" is linearly dependent if dim Spanjvi, . . ., V 5 } =4. 

Solution : Suppose that the subspace H= Span {vi, ...,¥ 5 } is four-dimensional. If {vi, ...,¥ 5 } were 
linearly independent, it would be a basis for H. This is impossible, by the statement just before the 
definition of dimension in Section 2.9, which essentially says that every basis of a ^-dimensional 
subspace consists of p vectors. Thus, {vi, . . ., V 5 } must be linearly dependent. 

23. A 3x4 matrix A with a two-dimensional column space has two pivot columns. The remaining two 
columns will correspond to free variables in the equation Ax = 0. So the desired construction is possible. 
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There are six possible locations for the two pivot columns, one of which is 


0 

0 


g * * 

0 0 0 


. A simple 


construction is to take two vectors in R that are obviously not linearly dependent, and put two copies of 
these two vectors in any order. The resulting matrix will obviously have a two-dimensional column 
space. There is no need to worry about whether Nul A has the correct dimension, since this is guaranteed 
by the Rank Theorem: dim Nul A = 4 - ra nk A. 


24. A ra nk 1 matrix has a one-dimensional column space. Every column is a multiple of some fixed vector. 
To construct a 4x3 matrix, choose any nonzero vector in R 4 , and use it for one column. Choose any 
multiples of the vector for the other two columns. 

25. The p columns of A span Col A by definition. If dim Col A -p, then the spanning set of p columns is 

automatically a basis for Col A, by the Basis Theorem. In particular, the columns are linearly 
independent. 

26. If columns a 3 , a 5 , and a 6 of A are linearly independent and if dim Col A = 4, then {a l5 a 3 , a 5 , a 6 } is a 

linearly independent set in a 4-dimensional column space. By the Basis Theorem, this set of four vectors 
is a basis for the column space. 

27. a. Start with B = [bi ••• b p ]andA = [ai ••• a 9 ], where q > p. For/ = 1, ..., q, the vector a, is 

in W. Since the columns of B span W, the vector a 7 is in the column space of B. That is, a, = Be, for 
some vector c 7 of weights. Note that c y is in R' because B has p columns. 

b. Let C = [ci • • • cj. Then C is a pxq matrix because each of the q columns is in R p . 

By hypothesis, q is larger than p, so C has more columns than rows. By a theorem, the columns of 
C are linearly dependent and there exists a nonzero vector u in R 9 such that Cu = 0. 

c. From part (a) and the definition of matrix multiplication 

A = [ ai • • • a, 7 ] = [Sc i • • • Bc q \ = BC 

From part (b), Au = (BC) u = B(Cu) = BO = 0. Since u is nonzero, the columns of A are linearly 
dependent. 

28. If A contained more vectors than B, then A would be linearly dependent, by Exercise 27, because B 
spans W. Repeat the argument with B and A interchanged to conclude that B cannot contain more 
vectors than A. 

29. [M] Apply the matrix command ref or rref to the matrix [vi v 2 x]: 


"11 

14 

19' 


"© 

0 

-1.667" 

-5 

-8 

-13 


0 

(D 

2.667 

10 

13 

18 


0 

0 

0 

_ 7 

10 

15 


0 

0 

0 


The equation ciVi + c 2 v 2 = x is consistent, so x is in the subspace H. The decimal approximations suggest 
Ci = -5/3 and C 2 = 8/3, and it can be checked that these values are precise. Thus, the S-coordinate of x is 
(-5/3, 8/3). 

30. [M] Apply the matrix command ref or rref to the matrix [vi v 2 v 3 x]: 


1 

1 

OS 

OO 

-9 

4" 


(D 

0 

0 

3" 

4 

-3 

5 

7 


0 

© 

0 

5 

-9 

7 

-8 

-8 


0 

0 

© 

2 

1 

4^ 

-3 

3 

3 


0 

0 

0 

0 
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The first three columns of [vj v 2 v 3 x] are pivot columns, so Vi, v 2 and v 3 are linearly independent. 
Thus Vi, v 2 and v 3 form a basis B for the subspace H which they span. View [vi v 2 v 3 x] as an 
augmented matrix for ciVi + c 2 v 2 + c 3 v 3 = x. The reduced echelon form shows that x is in H and 


Mb = 


3 

5 

2 


Notes: The Study Guide for Section 2.9 contains a complete list of the statements in the Invertible Matrix 
Theorem that have been given so far. The format is the same as that used in Section 2.3, with three columns: 
statements that are logically equivalent for any m y n matrix and are related to existence concepts, those that 
are equivalent only for any n y n matrix, and those that are equivalent for any n y p matrix and are related to 
uniqueness concepts. Four statements are included that are not in the text’s official list of statements, to give 
more symmetry to the three columns. 

The Study Guide section also contains directions for making a review sheet for “dimension” and “rank.” 


Chapter 2 SUPPLEMENTARY EXERCISES 


1. a. True. If A and B are m y n matrices, then B 1 has as many rows as A has columns, so AB r is defined. 
Also, A t B is defined because A r has m columns and B has m rows. 

b. False. B must have 2 columns. A has as many columns as B has rows. 

c. True. The zth row of A has the form (0, . . ., d t , . . ., 0). So the zth row of AB is (0, . . ., d„ . . ., 0 )B, which 
is di times the zth row of B. 

d. False. Take the zero matrix for B. Or, construct a matrix B such that the equation Bx = 0 has 
nontrivial solutions, and construct C and D so that C ^ D and the columns of C - D satisfy the 
equation Bx = 0. Then B(C - D) = 0 and BC = BD. 



“1 0" 


"0 0‘ 

e. False. Counterexample: A = 

0 0 

and C = 

° 1 


f. False. (A + B)(A - B) = A 2 - AB + BA - B 2 . This equals A 2 - B 2 if and only if A commutes with B. 

g. True. An n y n replacement matrix has n + 1 nonzero entries. The n y n scale and interchange matrices 
have n nonzero entries. 

h. True. The transpose of an elementary matrix is an elementary matrix of the same type. 

i. True. An n y n elementary matrix is obtained by a row operation on /„. 

j. False. Elementary matrices are invertible, so a product of such matrices is invertible. But not every 
square matrix is invertible. 

k. True. If A is 3x3 with three pivot positions, then A is row equivalent to / 3 . 

l. False. A must be square in order to conclude from the equation AB = I that A is invertible. 

m. False. AB is invertible, but ( AB ) _1 = B~ l A~ l , and this product is not always equal to A ' B '. 

n. True. Given AB = BA, left-multiply by A~ l to get B = A~'BA, and then right-multiply by A 1 to obtain 
BA _1 = A 'B. 

o. False. The correct equation is ( rA)~ l = i ri A~\ because 
(rA)(r~ l A~ l ) = (zr^XzLT 1 ) =!•/=/. 


p. True. If the equation Ax = 


1 

0 

0 


has a unique solution, then there are no free variables in this equation, 


which means that A must have three pivot positions (since A is 3><3). By the Invertible Matrix 
Theorem, A is invertible. 
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" 7 -5" 


'-7/2 

5/2" 

-6 4 _ 


3 

-2 



"0 

0 

O' 



0 

0 

ol 

"0 

0 

o' 


'0 

0 

0" 

li 

cd 

1 

0 

0 

, A 2 

= 

1 

0 

0 

1 

0 

0 

= 

0 

0 

0 


0 

1 

0_ 



0 

1 

°J 

0 

1 

0 


1 

0 

0 




1 

o 

o 

o' 

r° 

0 

0 


"0 

0 

o' 




A 3 = 

A 

A 2 = 

1 

0 

0 

0 

0 

0 

= 

0 

0 

0 







0 1 

0 

[l 

0 

0 


0 

0 

0 





Next, (7 - A)(I + A + A 2 ) = I + A + A 2 - A(I + A + A 2 ) = I + A + A 2 - A- A 2 - A 3 = I - A 3 . 
Since A 3 = 0, (/ - A)(I + A + A 2 ) = I . 


4. From Exercise 3, the inverse of I -A is probably I + A + A 2 + ■ ■ ■ + A" ’. To verify this, compute 

{I - A){I + A + --- + A n ~ x ) = I + A + ■■■ + A n ~ x - A{I + A + --- + A n ~ x ) = I - AA n ~ x = I - A n 

If A n = 0, then the matrix B = I + A + A 2 + ■ ■ ■ + A" 1 satisfies (/ - A)B = 7 Since I- A and B are square, 
they are invertible by the Invertible Matrix Theorem, and B is the inverse of I -A. 

5. A 2 = 2A - 1. Multiply by A: A 3 = 2 A 2 -A. Substitute A 2 = 2A - /: A 3 = 2(2 A -I) -A = 3A-2I. 

Multiply by A again: A 4 = A(3A - 21) = 3 A 2 - 2 A. Substitute the identity A 2 -2A- 1 again: 

Finally, A 4 = 3(2A -1)-2A = 4A- 31. 



"1 0" 


"0 f 


" 0 f 

6. Let A = 

0 -1 

and B = 

1 0 

. By direct computation, A 2 = I, B 1 = I, and AB = 

-1 0 


7. (Partial answer in Study Guide) Since A l B is the solution of AX = B, row reduction of [A B\ to [I X ] 
will produce X= A~ l B. See Exercise 12 in Section 2.2. 


"1 

3 

8 

-3 

5" 


"1 

3 

8 

-3 

5" 


"1 

3 

8 

-3 

5' 

2 

4 

11 

1 

5 

~ 

0 

-2 

-5 

7 

-5 

~ 

0 

1 

3 

-6 

1 

1 

2 

5 

3 

4 


0 

-1 

-3 

6 

-1 


0 

-2 

-5 

7 

-5 


"1 

3 

8 

-3 

5" 


"1 

3 

0 

37 

29" 


"1 

0 

0 

10 

-f 

0 

1 

3 

-6 

1 

~ 

0 

1 

0 

9 

10 

~ 

0 

1 

0 

9 

10 

0 

0 

1 

-5 

-3 


0 

0 

1 

-5 

-3 


0 

0 

1 

-5 

-3 


Thus, A~ l B 


10 -1 
9 10 

-5 -3 


8. By definition of matrix multiplication, the matrix A satisfies 


"1 

2" 


"1 

3" 

3 

7_ 


1 

1 


A 
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Right-multiply both sides by the inverse of 


1 

3 


2 

7 


. The left side becomes A. Thus, 


"1 

3' 

' 7 

-2 


"-2 

f 

1 

1 

-3 

1 


_ 4 

-1 


9. Given AB = 


B~ l 


5 

-2 

1 

-2 


4 

3 

-3 

7 


and B = 


7 

2 


, notice that ABB 1 = A. Since det B = 7 - 6 =1, 


and4 = (45)£ _1 


5 

4' 

1 

-3' 


'-3 

13 

-2 

3 

-2 

7_ 


_- 8 

27. 


Note: Variants of this question make simple exam questions. 

10. Since A is invertible, so is A T , by the Invertible Matrix Theorem. Then A T A is the product of invertible 
matrices and so is invertible. Thus, the formula (A r A)~ l A r makes sense. By Theorem 6 in Section 2.2, 

(A r A)~ 1 -A r =A 1 (A t )- 1 A t = A~ 1 I = A- 1 

An alternative calculation: ( A T A)~ 1 A T -A = (A I A) I (A I A) = I. Since A is invertible, this equation shows that 
its inverse is ( A T A)~ l A T . 

For i= 1,..., n, p(x,) = c 0 + c\x-, + • • • + c nA x n ~ X = row,- (V) ■ 

By a property of matrix multiplication, shown after Example 6 in Section 2.1, and the fact that c was 
chosen to satisfy Vc= y, 

row,- (V)c = row,- (Vc) = row,- (y) = y,- 

Thus,y>(x,) =y l . To summarize, the entries in Vc are the values of the polynomial p(x) atx\, ..., x n . 

Suppose jci, . . ., x„ are distinct, and suppose Vc = 0 for some vector c. Then the entries in c are the 
coefficients of a polynomial whose value is zero at the distinct points jti, ..., x n . Flowever, a nonzero 
polynomial of degree n — 1 cannot have n zeros, so the polynomial must be identically zero. That is, 
the entries in c must all be zero. This shows that the columns of V are linearly independent. 

(Solution in Study Guide ) When x\, ..., x„ are distinct, the columns of V are linearly independent, 
by (b). By the Invertible Matrix Theorem, V is invertible and its columns span R". So, for every 
y = (y i, . . . , y n ) in R", there is a vector c such that Vc = y. Let p be the polynomial whose coefficients 
are listed in c. Then, by (a ),p is an interpolating polynomial for {x\,y(), ..., (x„,y„). 

12. lfA= LU, then coli(4) = T-coli((/). Since coli((7) has a zero in every entry except possibly the first, 

Z. -col i ((7) is a linear combination of the columns of L in which all weights except possibly the first are 
zero. So coli(J) is a multiple of coli(L). 

Similarly, co h(A) = L-coh(U), which is a linear combination of the columns of L using the first two 

entries in col 2 (G) as weights, because the other entries in col 2 (G) are zero. Thus col 2(4 ) is a linear 
combination of the first two columns of L. 

13. a. P 2 = (uu r )(uu r ) = u(u r u)u r = u(l)u 7 = P , because u satisfies u r u = 1. 

b. P r =(uuY=u 7 T u r = uu r = P 

c. Q 2 = (l- 2P)(I -2 P)=I- 1(2 P) - 2 PI + 2P(2P) 

= I - 4P + 4 P 2 = /, because of part (a). 


11. a. 


b. 


c. 


~n — 1 


= row, (F)c . 
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14. 


Given u = 


0 

0 

1 


, define P and Q as in Exercise 13 by 



“0“ 



‘0 

0 

0“ 


"1 

0 

0" 


“0 

0 

0“ 


“1 

0 

o' 

P = uu r = 

0 

[0 

0 1] = 

0 

0 

0 

, Q=I-2P= 

0 

1 

0 

-2 

0 

0 

0 

= 

0 

1 

0 


1 



0 

0 

1 


0 

0 

1 


0 

0 

1 


0 

0 

-1 



T 


"0 

0 

0" 

T 


"0" 


"1 

0 

0" 

T 


f 

If x = 

5 

, then Px = 

0 

0 

0 

5 

= 

0 

and Qx = 

0 

1 

0 

5 

= 

5 


3 


0 

0 

1 

3 


3 


0 

0 

-1 

3 


-3 


15. Left-multiplication by an elementary matrix produces an elementary row operation: 

B ~ E y B ~ E 2 E i B ~ E 2 E 2 E X B = C 

so B is row equivalent to C. Since row operations are reversible, C is row equivalent to B. (Alternatively, 
show C being changed into B by row operations using the inverse of the E, .) 

16. Since A is not invertible, there is a nonzero vector v in R" such that Av = 0. Place n copies of v into an 
n x« matrix B. Then AB = A\y • • • v] = [Ay ■ ■ ■ Ay] = 0. 

17. Let A be a 6x4 matrix and B a 4x6 matrix. Since B has more columns than rows, its six columns are 
linearly dependent and there is a nonzero x such that Bx = 0. Thus ABx = 40 = 0. This shows that the 
matrix AB is not invertible, by the 1MT. (Basically the same argument was used to solve Exercise 22 in 
Section 2.1.) 


Note: (In the Study Guide) It is possible that BA is invertible. Lor example, let C be an invertible 4x4 matrix 


and construct A = 


C 

0 


and B = [C 1 0]. Then BA = / 4 , which is invertible. 


18. By hypothesis, A is 5x3, C is 3x5, and^C = / 3 . Suppose x satisfies Ax = b. Then CAx = Cb. Since 
CA= I, x must be Cb. This shows that Cb is the only solution of Ax = b. 


19. 


[M] Let A = 


".4 

.2 

.3" 


".31 

.26 

.30" 

.3 

.6 

.3 

. Then A 2 = 

.39 

.48 

.39 

.3 

.2 

.4 


.30 

.26 

.31 


. Instead of computing A 3 next, speed up the 


calculations by computing 



“.2875 

.2834 

.2874" 


“.2857 

.2857 

.2857" 

A 4 = A 2 A 2 = 

.4251 

.4332 

.4251 

, A 8 = A 4 A 4 = 

.4285 

.4286 

.4285 


.2874 

.2834 

.2875 


.2857 

.2857 

.2857 


To four decimal places, as k increases, 



".2857 

.2857 

.2857" 


“2/7 

2/7 

2/7" 

A k ^ 

.4286 

.4286 

.4286 

, or, in rational format, A k — > 

3/7 

3/7 

3/7 


.2857 

.2857 

.2857 


2/7 

2/7 

2/7 
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0 .2 .3 


.1 

.6 

.3 

, then 

.9 

.2 

.4 



.2119 

.1998 

b 4 = 

.3663 

.3764 


.4218 

.4218 



.29 .18 .18 

B 2 = 

.33 .44 .33 


.38 .38 .49 

.1998" 


".2024 

.3663 

, B* = 

.3707 

.4339 


.4269 


.2022 

.3709 

.4269 


.2022 

.3707 

.4271 


To four decimal places, as k increases, 



“.2022 

.2022 

.2022" 


“18/89 

18/89 

18/89" 

B k 

.3708 

.3708 

.3708 

, or, in rational format, B k —> 

33/89 

33/89 

33/89 


.4270 

.4270 

.4270 


38/89 

38/89 

38/89 


20. [M] The 4x4 matrix A 4 is the 4x4 matrix of ones, minus the 4x4 identity matrix. The MATLAB 
command is A4 = ones (4 ) - eye (4 ) . For the inverse, use inv (A4 ) . 



"0 

1 

1 

1“ 


"-2/3 

1/3 

1/3 

1/3" 


1 

0 

1 

1 


1/3 

-2/3 

1/3 

1/3 

A, = 





, a: 1 = 






1 

1 

0 

1 


1/3 

1/3 

-2/3 

1/3 


1 

1 

1 

0 


1/3 

1/3 

1/3 

-2/3 


0 

1 

1 

1 

1" 


'-3/4 

1/4 

1/4 

1/4 

1/4 

1 

0 

1 

1 

1 


1/4 

-3/4 

1/4 

1/4 

1/4 

1 

1 

0 

1 

1 

A~ l - 

5 ^5 — 

1/4 

1/4 

-3/4 

1/4 

1/4 

1 

1 

1 

0 

1 


1/4 

1/4 

1/4 

-3/4 

1/4 

1 

1 

1 

1 

0 


1/4 

1/4 

1/4 

1/4 

-3/4 


0 

1 

1 

1 

1 

1" 


"-4/5 

1/5 

1/5 

1/5 

1/5 

1/5 

1 

0 

1 

1 

1 

1 


1/5 

—4/ 5 

1/5 

1/5 

1/5 

1/5 

1 

1 

0 

1 

1 

1 

, A _1 = 

1/5 

1/5 

-4/5 

1/5 

1/5 

1/5 

1 

1 

1 

0 

1 

1 

1/5 

1/5 

1/5 

-4/5 

1/5 

1/5 

1 

1 

1 

1 

0 

1 


1/5 

1/5 

1/5 

1/5 

-4/5 

1/5 

1 

1 

1 

1 

1 

0 


1/5 

1/5 

1/5 

1/5 

1/5 

-4/5 


The construction of A ( , and the appearance of its inverse suggest that the inverse is related to h,. In fact, 
1 + / 6 is 1/5 times the 6x6 matrix of ones. Let J denotes the n *n matrix of ones. The conjecture is: 

A„ = J-I n and A~ l = — — J-I n 

n - 1 

Proof. (Not required) Observe that J 2 = nJ and A n J = (J-I)J = J 2 -J = (n - 1) J. Now compute 
A„({n-\y l J-I) = (n- \)~ x A n J - A„ = J - (J - 1) = / 

Since A n is square, A„ is invertible and its inverse is (n - 1 





Determinants 


3.1 


SOLUTIONS 


Notes: Some exercises in this section provide practice in computing determinants, while others allow the 
student to discover the properties of determinants which will be studied in the next section. Determinants are 
developed through the cofactor expansion, which is given in Theorem 1. Exercises 33-36 in this section 
provide the first step in the inductive proof of Theorem 3 in the next section. 


1. Expanding along the first row: 
3 0 4 1 


2 

-1 


= 3 


3 2 
5 -1 


-0 


2 2 
0 -1 


+ 4 


= 3(-13) + 4(10) = 1 


Expanding along the second column: 
3 0 4 1 


2 

-1 


= (-l) 1+2 -0 


2 2 
0 -1 


+ (-l) 2+2 -3 


4 

-1 


+ (-l) 3+2 -5 


= 3(-3) - 5(-2) = 1 


2. Expanding along the first row: 
|0 5 1 1 


4-3 0 

2 4 1 


= 0 


-3 0 

4 1 


-5 


4 0 
2 1 


+ 1 


4 -3 

2 4 


Expanding along the second column: 
0 5 1| 


4-3 0 

2 4 1 


= (-1) 1+2 • 5 


4 0 
2 1 


= -5(4) + 1(22) = 2 


+ (-l) 2+2 -(-3) 


0 1 
2 1 


+ (-1) 3+2 • 4 


0 1 
4 0 


= -5(4) - 3(-2) - 4( — 4) = 2 


3. Expanding along the first row: 
1 2 -4 3 1 


1 2 
4 -1 


= 2 


1 2 
4 -1 


-(-4) 


2 

-1 


+ 3 


3 1 
1 4 


= 2(-9) + 4(— 5) + (3)(1 1) = -5 


159 



160 CHAPTER 3 


Determinants 


Expanding along the second column: 
2-4 3 


1 2 
4 -1 


= (-l) 1+2 -(-4) 


3 2 

1 -1 


+ (-l) 2+2 -l 


+ (-1) 3+2 • 4 


2 3 

3 2 


= 4(— 5) + l(— 5) 


4. Expanding along the first row: 
1 3 5 1 


1 1 
4 2 


= 1 


1 1 
4 2 


-3 


2 1 
3 2 


+ 5 


2 1 
3 4 


= 1(— 2) - 3(1) + 5(5) = 20 


Expanding along the second column: 
1 3 5 1 


2 1 1 
3 4 2 


= (-l) 1+2 -3 


2 1 
3 2 


+ (-l) 2+2 -1 


1 5 
3 2 


+ (-l) 3+2 -4 


1 5 

2 1 


= -3(l) + l(-13)-4(-9; 


5. Expanding along the first row: 
1 2 3 -4 1 


4 0 

5 1 


= 2 


0 5 

1 6 


-3 


4 5 

5 6 


+ (- 4 ) 


4 0 

5 1 


= 2(-5) - 3( — 1) - 4(4) = -23 


6. Expanding along the first row: 
5-2 4 1 


0 3-5 

2-4 7 


= 5 


3 -5 

-4 7 


-(- 2 ) 


-5 

7 


+ 4 


0 3 

2 -4 


= 5(1) + 2(10) + 4(— 6) = 1 


7. Expanding along the first row: 
1 4 3 0| 


6 5 2 

9 7 3 


= 4 


5 2 
7 3 


-3 


6 2 
9 3 


+ 0 


6 5 
9 7 


= 4(1) -3(0) = 4 


8. Expanding along the first row: 
1 6 

I 10 3, 

-1 


4 0 3 

3-2 5 


0 3 

-2 5 


4 3 
3 5 


+ 6 


0 

-2 


= 8(6) - 1(1 1) + 6(-8) = -1 1 


9. First expand along the third row, then expand along the first row of the remaining matrix: 

6 0 0 5 1 

10 0 51 , 

7 2 


17 2-5 
2 0 0 0 
8 3 18 



0 

0 

5 

= (-1) 3+1 • 2 

7 

2 

-5 


3 

1 

8 


= 2 • (-1) 1+3 • 5 


3 1 


-4(— 5) 


= 20 


= 10 ( 1 ) = 10 
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10 . First expand along the second row, then expand along either the third row or the second column of the 
remaining matrix. 

1 -2 5 2 1 

0 0 3 0 

2-6-7 5 

5 0 4 4 



1 

-2 

2 

= (-l) 2+3 -3 

2 

-6 

5 


5 

0 

4 


f 


= (- 3 ) 


(- 1) 3+1 ' 5 


V 


-2 2 
-6 5 


+ (-1) 3+3 • 4 


1 -2 

2 -6 


= (-3) (5(2) + 4(-2)) = -6 


or 

1- 2 5 2 

0 0 3 0 

2- 6-7 5 

5 0 4 4 



1 

-2 

2 

= (-l) 2+3 -3 

2 

-6 

5 


5 

0 

4 


f 


= (- 3 ) 


(- 1) 1+2 • (- 2 ) 


2 5 
5 4 


+ (-l) 2+2 -(-6) 


1 

2 

\ 

5 

4 

) 


= ( — 3)(2( — 17) - 6(-6)) = -6 


11 . There are many ways to do this determinant efficiently. One strategy is to always expand along the first 
column of each matrix: 


3 5-84 

0-2 3-7 

0 0 15 

0 0 0 2 


= (-l) I+1 -3 


-2 3 -7 

0 1 5 

0 0 2 


= 3 - (-1) 1+I - (-2) 


1 5 
0 2 


= 3(— 2)(2) = -12 


12 . There are many ways to do this determinant efficiently. One strategy is to always expand along the first 
row of each matrix: 


4 0 0 

7-10 
2 6 3 


5-8 4-3 


= (- 1) 1+1 • 4 


-10 0 
6 3 0 

-8 4 -3 


= 4 • (— l)' +l • (— 1) 


3 0 

4 -3 


= 4(— 1)( —9) = 36 


13 . First expand along either the second row or the second column. Using the second row, 
14 0 -7 3 -5 1 


0 0 2 0 0 

7 3 -6 4 -8 

5 0 5 2 -3 

0 0 9 -1 2 


= (- 1) 2+3 • 2 


4 0 
7 3 

5 0 


3 -5 

4 -8 

2 -3 


0 0-1 


Now expand along the second column to find: 

4 0 3 -5 

7 3 4 -8 

5 0 2 -3 

0 0-1 2 


(- 1) 2+3 • 2 


= — 2 


(-l) 2+2 -3 


V 


4 3-5 

5 2-3 
0-12 
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Now expand along either the first column or third row. The first column is used below. 


3 -5 


0 -1 


2 -3 


3 -5 


= ( 6)(4(1) - 5(1)) = 6 


14 . First expand along either the fourth row or the fifth column. Using the fifth column, 


6 

3 

2 

4 

0 










6 

3 

2 

4 

9 

0 

-4 

1 

0 










9 

0 

-4 

1 

8 

-5 

6 

7 

1 

= (-l) 3+5 -l 









3 

0 

0 

0 

3 

0 

0 

0 

0 










4 

2 

3 

2 

4 

2 

3 

2 

0 






Now expand along the third row to find: 


6 

3 

2 

4 


( 

9 

1 

0 

-4 

1 

= 1 

(-1) 3+1 -3 

3 

0 

0 

0 


4 

2 

3 

2 





Now expand along either the first column or second row. The first column is used below. 

f 3 2 4 , v 

1 (-l) 3+l -3 0 -4 1 = 3(-l) 1+1 -3~ + (-1) 3+1 • 2 = (3)(3( — 1 1) + 2(18)) = 9 

2 3 2 ^ ' 


3 0 4 

15 . 2 3 2 = (3)(3)(— 1 ) + (0)(2)(0) + (4)(2)(5) - (0)(3)(4) - (5)(2)(3) - (-1)(2)(0) = 

0 5-1 

-9 + 0 + 40 - 0 - 30 -0 = 1 


0 5 1 

16 . 4 -3 0 = (0)(-3)(l) + (5)(0)(2) + (1)(4)(4) - (2)(-3)(l) - (4)(0)(0) - (1)(4)(5) = 

2 4 1 

0 + 0+ 16 -(-6)- 0-20 = 2 

2-4 3 

17 . 3 1 2 = (2)( 1 )(— 1 ) + ( 4)(2)(1) + (3)(3)(4) - (1)(1)(3) - (4)(2)(2) - (-l)(3)(-4) = 

1 4 -1 

—2 + (—8) + 36 — 3 — 16 — 12 = —5 

1 3 5 

18 . 2 1 1 = (1)(1)(2) + (3)(1)(3) + (5)(2)(4) - (3)(1)(5) - (4)(1)(1) - (2)(2)(3) = 

3 4 2 

2 + 9 + 40-15-4-12 = 20 
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a b c d 

19. =ad-bc, = cb - da = -(ad - be) 

c d a b 

The row operation swaps rows 1 and 2 of the matrix, and the sign of the determinant is reversed. 
a b a b 

20. =ad-bc, = a(kd)-(kc)b =kad -kbc = k(ad -be) 

c d kc kd 

The row operation scales row 2 by k, and the determinant is multiplied by k. 


3 4 

3 

4 

= 18-20 = -2, 

5 6 

5 + 3k 

6 + 4k 


21. =18-20 = -2, = 3(6 + 4k) - (5 + 3k)4 = -2 

5 6 5 + 3k 6 + 4k 

The row operation replaces row 2 with k times row 1 plus row 2, and the determinant is unchanged. 
a b a + kc b + kd 

22. =ad-bc, = (a + kc)d -c(b + kd) = ad + ked -be -ked = ad -be 

c d c d 

The row operation replaces row 1 with k times row 2 plus row 1 , and the determinant is unchanged. 



1 

1 

1 

k 

k 

k 

23. 

-3 

8 

-4 

= 1(4) - 1(2) + 1( — 7) = -5, -3 

8 

-4 


2 

-3 

2 

2 

-3 

2 


The row operation scales row 1 by k, and the determinant is multiplied by k. 
a b c 

24. 3 2 2 = a(2)-b(6) + c(3) = 2a-6b + 3c, 

6 5 6 

3 2 2 

a b c =3(6b-5c)-2(6a-6c) + 2(5a-6b) = -2a + 6b-3c 
6 5 6 

The row operation swaps rows 1 and 2 of the matrix, and the sign of the determinant is reversed. 

25. Since the matrix is triangular, by Theorem 2 the determinant is the product of the diagonal entries: 

1 0 0 

0 1 0 =( 1 )( 1 )( 1 ) = 1 

0 k 1 

26. Since the matrix is triangular, by Theorem 2 the determinant is the product of the diagonal entries: 

1 0 0 

0 1 0 =( 1 )( 1 )( 1 ) = 1 

k 0 1 


27. Since the matrix is triangular, by Theorem 2 the determinant is the product of the diagonal entries: 
k 0 0 

0 1 0 = (k)(l)(l) = k 

0 0 1 
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28. Since the matrix is triangular, by Theorem 2 the determinant is the product of the diagonal entries: 


1 0 
0 k 
0 0 


0 

0 

1 


= (1)(*)(1) = * 


29. A cofactor expansion along row 1 gives 


0 1 
1 0 
0 0 


= -l 


0 

1 


= -l 


30. A cofactor expansion along row 1 gives 


0 0 
0 1 
1 0 


= 1 


1 

0 


= -l 


31. A 3 x 3 elementary row replacement matrix looks like one of the six matrices 


“1 

0 

0“ 


“1 

0 

0“ 


“1 

0 

0“ 


“1 

0 

0“ 


“1 

0 

k 


“1 

k 

0" 

k 

1 

0 

9 

0 

1 

0 

9 

0 

1 

0 

9 

0 

1 

k 

9 

0 

1 

0 

9 

0 

1 

0 

0 

0 

1 


k 

0 

1 


0 

k 

1 


0 

0 

1 


0 

0 

1 


0 

0 

1 


In each of these cases, the matrix is triangular and its determinant is the product of its diagonal entries, 
which is 1. Thus the determinant of a 3 x 3 elementary row replacement matrix is 1. 

32. A 3 x 3 elementary scaling matrix with k on the diagonal looks like one of the three matrices 


k 

0 

0" 


"1 

0 

0" 


"1 

0 

0" 

0 

1 

0 

9 

0 

k 

0 

9 

0 

1 

0 

0 

0 

1 


0 

0 

1 


0 

0 

k 


In each of these cases, the matrix is triangular and its determinant is the product of its diagonal entries, 
which is k. Thus the determinant of a 3 x 3 elementary scaling matrix with k on the diagonal is k. 



“0 

f 


a b 


c d 

33. E = 

1 

0 

, A = 

c d 

, EA = 

a b 


&etE = -\,&QtA = ad- be, 

det EA = cb - da = -1 {ad - be) = (det iT)(det A) 



n oi 

i 

a b 


f a b 1 

34. E = 

i 

0 

1 

ii 

c d 

, EA = 

1 

?r 

i 


det E = k, det A = ad - be, 

det EA = a(kd) - (kc)b = k(ad - be) = (det Zf)( det A) 



*1 k 


a b 


a + kc 

b + kd 

35. E = 

0 1 

, A = 

c d 

, EA = 

c 

d 


det E = 1 , det A = ad - be, 

det EA = (a + kc)d - c(b + kd) = ad + ked -be- ked = 1 {ad - be) = (det £)(det A) 
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"1 O' 


a b 


a b 

36. E = 

k 1 

, A = 

c d 

, EA = 

ka + c kb + d 


det E = 1 , det A = ad - be, 

det EA = a{kb + d)-{ka + c)b = kab + ad- kab -bc= 1 {ad - be) = (det £)(det A) 


37. 



5 A = 


15 

20 


5 

10 


, det A 


2, det 5 A 


50 * 5det A 


38. 




kb 

kd 


, det A 


ad - be. 


det kA = (ka)(kd) - (kb)(kc) = k 2 (ad -be) = k^detA 

39. a. True. See the paragraph preceding the definition of the determinant, 
b. False. See the definition of cofactor, which precedes Theorem 1. 

40. a. False. See Theorem 1. 
b. False. See Theorem 2. 


41. The area of the parallelogram determined by u = 


v = 


u + v, and 0 is 6, since the base of the 


parallelogram has length 3 and the height of the parallelogram is 2. By the same reasoning, the area of 


the parallelogram determined by u = 


x = 


, u + x, and 0 is also 6. 


x 2 




Also note that det[u v] = det 


3 1 
0 2 


= 6, and det [u x] = det 


3 x 
0 2 


= 6. The determinant of the 


matrix whose columns are those vectors which define the sides of the parallelogram adjacent to 0 is equal 
to the area of the parallelogram. 


42. The area of the parallelogram determined by u = 


v 


. u v. and 0 is cb, since the base of the 


parallelogram has length c and the height of the parallelogram is b. 


x. 


u 


166 CHAPTER 3 • Determinants 


• Cl C • - C d 

Also note that det u v = det = -cb , and det v u = det = cb. The determinant of the 

L J [_b °J L J L° b . 

matrix whose columns are those vectors which define the sides of the parallelogram adjacent to 0 either 
is equal to the area of the parallelogram or is equal to the negative of the area of the parallelogram. 

43. [M] Answers will vary. The conclusion should be that det (A + B) ^ det A + det B. 

44. [M] Answers will vary. The conclusion should be that det (AB) = (det J)(det B). 

45. [Ml Answers will vary. For 4x4 matrices, the conclusions should be that det A 1 = det A, det (-A) = 
det A, det(2 A) = 16det A, and det (10 A) = 10 4 detJ . For 5x5 matrices, the conclusions should be that 
det A r = det A, det(-4) = -det A, det(2 A) = 32det A, and det (1 0 A) = 1 0 5 det A. For 6x6 matrices, the 
conclusions should be that det^ r =det A, det(-A) = det A, det(2A) = 64det A, and det (10 J) = 10 6 det A. 

46. [M] Answers will vary. The conclusion should be that det A 1 = 1 / det A. 


3.2 SOLUTIONS 

Notes: This section presents the main properties of the determinant, including the effects of row operations 
on the determinant of a matrix. These properties are first studied by examples in Exercises 1-20. The 
properties are treated in a more theoretical manner in later exercises. An efficient method for computing the 
determinant using row reduction and selective cofactor expansion is presented in this section and used in 
Exercises 11-14. Theorems 4 and 6 are used extensively in Chapter 5. The linearity property of the 
determinant studied in the text is optional, but is used in more advanced courses. 


1. Rows 1 and 2 are interchanged, so the determinant changes sign (Theorem 3b.). 

2. The constant 2 may be factored out of the Row 1 (Theorem 3c.). 

3. The row replacement operation does not change the determinant (Theorem 3a.). 


4. The row replacement operation does not change the determinant (Theorem 3a.). 



1 

5 

-6 


1 

5 

-6 


1 

5 

-6 

5. 

-1 

-4 

4 

= 

0 

1 

-2 

= 

0 

1 

-2 


-2 

-7 

9 


0 

3 

-3 


0 

0 

3 



1 

5 

-3 


1 

5 

-3 

1 

5 

-3 

1 

5 

-3 

6. 

3 

-3 

3 

= 

0 

-18 

12 =6 

0 

-3 

2 =6 

0 

-3 

2 


2 

13 

-7 


0 

3 

-1 

0 

3 

-1 

0 

0 

1 


= (6)(-3) = -18 


1 

3 

0 

2 


1 

3 

0 

2 


1 

3 

0 

2 


1 

3 

0 

2 

-2 

-5 

7 

4 


0 

1 

7 

8 


0 

1 

7 

8 


0 

1 

7 

8 

3 

5 

2 

1 


0 

-4 

2 

-5 


0 

0 

30 

27 


0 

0 

30 

27 

1 

-1 

2 

-3 


0 

-4 

2 

-5 


0 

0 

30 

27 


0 

0 

0 

0 
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3 -4 

2 -5 

4 -3 

-5 2 


1 3 3 

0 1 2 

0 -1 -2 

0 2 4 


13 3-4 

0 12-5 

0 0 0 0 

0 0 0 0 


1 -1 -3 


3 -1 -2 


1 -1 

0 1 

0 1 

0 2 


-1 -3 

1 5 

0 0 
0 -3 


1 -1 

0 1 

0 0 

0 0 


-3 0 

5 4 

-3 -5 

0 1 


= -(-3) =3 


1 

3 

-1 

0 

-2 

0 

2 

-4 

-1 

-6 

-2 

-6 

2 

3 

9 

3 

7 

-3 

8 

-7 

3 

5 

5 

2 

7 

1 

3 

-1 

0 

-2 

0 

2 

-4 

-1 

-6 

0 

0 

-4 

7 

-7 

0 

0 

0 

3 

5 

0 

0 

0 

0 

1 


0 -2 

-1 -6 


-7 0-2 0 

7 0-48 


-1 0 -2 

-4 -1 -6 

0 3 5 

-4 7 -7 

0 0 1 


11 . First use a row replacement to create zeros in the second column, and then expand down the second 
column: 


5 -3 -12 5 -3 -1 


3 0 1-3 


3 0 1-3 


-6 0 -4 9 -6 0 -4 

4 10 -4 -1 0 0 2 


3 1 -3 

= -5 -6 -4 9 

0 2 1 


Now use a row replacement to create zeros in the first column, and then expand down the first column: 
3 1-3 3 1-3 

-2 3 

-5 -6 -4 9 =-5 0 -2 3 =(-5)(3) = (— 5)(3)(— 8) = 120 

0 2 1 0 2 1 


12 . First use a row replacement to create zeros in the fourth column, and then expand down the fourth 
column: 


-1 2 3 0 -1 2 3 0 


3 4 3 0 


3 4 3 0 


5 4 6 6 -3 0 -2 0 


4 2 4 3 


4 2 4 3 


-12 3 

= 3 3 4 3 

-3 0 -2 


Now use a row replacement to create zeros in the first column, and then expand down the first column: 
-12 3 -12 3 

10 12 

334 3=30 10 12 =3(-l) =3(-l)(-38) = 114 

-3 0 -2 0 -6 -11 
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13 . First use a row replacement to create zeros in the fourth column, and then expand down the fourth 
column: 


2 5 4 1 

4 7 6 2 

6-2-40 
-6 7 7 0 


2 5 4 

0 -3 -2 

6 -2 -4 

-6 7 7 


= -l 


0 

6 

-6 


-3 

-2 

7 


-2 

-4 

7 


Now use a row replacement to create zeros in the first column, and then expand down the first column: 
0 -3 -2 | 

-3 -2 


-1 


0 -3 -2 

6 -2 -4 

-6 7 7 


= -l 


6 -2 -4 

0 5 3 


= (-l)(-6) 


3 


= (-l)(-6)(l) = 6 


14 . First use a row replacement to create zeros in the third column, and then expand down the third column: 


-3 

-2 

1 

-4 

1 

3 

0 

-3 

-3 

4 

-2 

8 

3 

-4 

0 

4 


-3 

-2 

1 

-4 

1 

3 

0 

-3 

-9 

0 

0 

0 

3 

-4 

0 

4 


= 1 


1 

-9 

3 


3 -3 

0 0 
-4 4 


Now expand along the second row: 


1 

3 

-3 


3 -3 


-9 

0 

0 

= l(-(-9)) 

—A A 

= (1)(9)(0) = 0 

3 

-4 

4 


— ‘-r *+ 




a 

6 

c 


a 

b 

c 

15 . 

r/ 

e 

/ 

= 5 

d 

e 

f 


5g 

5/7 

5/ 


g 

h 

i 


= 5(7) = 35 



a 

b 

c 


a 

b 

c 

16 . 

3d 

3e 

3/ 

= 3 

d 

e 

f 


g 

h 

i 


g 

h 

i 


= 3(7) = 21 


17 . 


a b c 
g h i 
d e f 


a b c 
d e f 
g h i 


= -7 



g 

h 

i 


a 

b 

c 


( 

a 

b 

c 

\ 


18 . 

a 

b 

c 

= - 

g 

h 

i 

= - 

- 

d 

e 

f 


= -(-7) = 7 


d 

e 

f 


d 

e 

f 


V 

g 

h 

i 

) 



a b c 


a b c 


a b c 

2 d+a 2 e+b 2 f+c 

= 

2d 2e 2/ 

= 2 

d e f 

g h i 


g h i 


g h i 


= 2(7) = 14 
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a + d 

b + e 

c + f 


a 

b 

c 

20. 

d 

e 

f 

= 

d 

e 

f 


g 

h 

i 


g 

h 

i 


21. Since 


2 

1 

1 


3 0 
3 4 
2 1 


-1^0, the matrix is invertible. 


22. Since 


5 

1 

0 


0 

-3 

5 


-1 

-2 

3 


= 0 , the matrix is not invertible. 


23. Since 


12 

1 

3 

0 


24. Since 


25. Since 


26. Since 


0 

-7 

8 

7 


7 

-4 

-6 

3 
5 

1-6 

4 


0 8 
-5 0 

6 0 
5 4 


= 0 , the matrix is not invertible. 


4 -7 -3 

6 
-7 


0 -5 

2 6 


-8 7 

5 0 

7 -5 


= 11^0, the columns of the matrix form a linearly independent set. 


= -1^0, the columns of the matrix form a linearly independent set. 


2 

-6 

0 

7 


-2 

-1 

3 

0 


= 0 , the columns of the matrix form a linearly dependent set. 


27. a. True. See Theorem 3. 

b. True. See the paragraph following Example 2. 

c. True. See the paragraph following Theorem 4. 

d. False. See the warning following Example 5. 

28. a. True. See Theorem 3. 

b. False. See the paragraphs following Example 2. 

c. False. See Example 3. 

d. False. See Theorem 5. 

29. By Theorem 6, deti? 5 = (dct Bf = (-2) 5 = -32 . 

30. Suppose the two rows of a square matrix A are equal. By swapping these two rows, the matrix A is not 
changed so its determinant should not change. But since swapping rows changes the sign of the 
determinant, det A = - det A. This is only possible if det A = 0. The same may be proven true for columns 
by applying the above result to A T and using Theorem 5. 
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31. By Theorem 6, (detJ)(detJ 1 ) = det/ = l,so det A 1 = 1 / det A. 

32. By factoring an r out of each of the n rows, det(rJ) = /'"det A. 

33. By Theorem 6, det AB = (det J)(det B) = (det /?)(det A) = det BA. 

34. By Theorem 6 and Exercise 31, 

det (PAP~ l ) = (det,P)(detJ)(det,P~ 1 ) = (det,P)(det.P~ 1 )(det A) 

f 1 1 

= (det,P) (detA) = ldetA 

v det P ^ 

= det A 

35. By Theorem 6 and Theorem 5, detU T U = (det// r )(det//) = (det//) 2 . Since U T U = /, 
detU T U = det/ = 1 , so (det//) 2 =1. Thus det //= ±1. 


36. By Theorem 6 det A 4 = (det A ) 4 . Since det A 4 = 0 , then (det A) 4 = 0 . Thus det A = 0, and A is not 
invertible by Theorem 4. 


37. One may compute using Theorem 2 that det A = 3 and det B = 8, while AB = 
det AB = 24 = 3 x 8 = (det J)(det B). 


17 4 


. Thus 


38. One may compute that det A = 0 and det B = -2, while AB = 
0 x -2 = (det d)(dct B). 


-2 0 


. Thus det AB = 0 = 


39. a. By Theorem 6, det AB = (det J)(det B) = 4 x -3 = -12. 

b. By Exercise 32, det5J = 5 3 det^4 = 125x4 = 500 . 

c. By Theorem 5, det B r =det/? = -3. 

d. By Exercise 31, det A~ { = 1 / det A = 1 / 4 . 

e. By Theorem 6, det Al = (det A) 3 = 4 3 = 64 . 


40. a. By Theorem 6, det AB = (det J)(det B) - -1 x 2 = -2. 

b. By Theorem 6, det/? 5 = (det/?) 5 = 2 5 = 32 . 

c. By Exercise 32, det2A = 2 4 detA = 16x-l = -16. 

d. By Theorems 5 and 6, det A r A = (det^ r )(det A) = (det J)(det A) = -lx-1 = 1 . 

e. By Theorem 6 and Exercise 31, 

det B l AB = (det/? -1 )(det ^)(detZ?) = (l/detZ?)(det J)(detZ?) = det^ = -1 . 

41. det A = {a + e)d - c{b + f) = ad + ed - be - cf= (ad - be) + (ed ~cf) = det B + det C. 

1 + a b 

42. det (A + B)= = (1 + a)(\ + d) — cb = 1 + a + d + ad -cb = detA + a + d + det/? , so 

c 1 + d 

det (A+ B) = det A + det B if and only if a + d = 0. 
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43. Compute det A by using a cofactor expansion down the third column: 

det A = (wj + v, )det A l3 - ( u 2 + v 2 )det A 23 + ( u 3 + v 3 )det A 33 

= w,det A l3 - « 2 det A 23 + « 3 det A 33 + v,dct A n - v 2 det A 23 + v 3 det A 33 
= deti? + detC 

44. By Theorem 5, det AE = det (A£) r . Since {AE) T = E T A r , det AE = det(E T A T ). Now E r is itself an 
elementary matrix, so by the proof of Theorem 3, det (E r A r ) = (detis r )(det A r ). Thus it is true that 
det AE = (detE T )(detA T ), and by applying Theorem 5, det AE = (det E)(detA). 

45. [M] Answers will vary, but will show that det A 7 A always equals 0 while det A A 7 should seldom be 
zero. To see why A T A should not be invertible (and thus det A r A = 0 ), let A be a matrix with more 
columns than rows. Then the columns of A must be linearly dependent, so the equation Ax = 0 must have 
a non-trivial solution x. Thus (A r A)x = A r (Ax) = A r 0 = 0 , and the equation ( A r A)x = 0 has a 
non-trivial solution. Since A 7 A is a square matrix, the Invertible Matrix Theorem now says that A r A is 
not invertible. Notice that the same argument will not work in general for AA r , since A r has more rows 
than columns, so its columns are not automatically linearly dependent. 

46. [M] One may compute for this matrix that det A = 1 and cond A ~ 23683. Note that this is the t 2 
condition number, which is used in Section 2.3. Since det A 0, it is invertible and 


-19 

-14 

0 

7 

-549 

-401 

-2 

196 

267 

195 

1 

-95 

-278 

-203 

-1 

99 


The determinant is very sensitive to scaling, as det 10 A = 10 4 det A = 10,000 and det 0. Id = 

(0. 1) 4 det ^4 = 0.0001. The condition number is not changed at all by scaling: cond(10d) = 
cond(O.ld) = concL4 ~ 23683. 

When A = I a , det A=\ and cond A = 1. As before the determinant is sensitive to scaling: 

det 10 A = 10 4 detJ = 10,000 and det 0. 1 A = (O.l) 4 det A = 0.0001. Yet the condition number is not 

changed by scaling: cond(lOJ) = cond(0. Id) = condd = 1. 


3.3 SOLUTIONS 

Notes: This section features several independent topics from which to choose. The geometric interpretation 
of the determinant (Theorem 10) provides the key to changes of variables in multiple integrals. Students of 
economics and engineering are likely to need Cramer’s Rule in later courses. Exercises 1-10 concern 
Cramer’s Rule, exercises 11-18 deal with the adjugate, and exercises 19-32 cover the geometric 
interpretation of the determinant. In particular, Exercise 25 examines students’ understanding of linear 
independence and requires a careful explanation, which is discussed in the Study Guide. The Study Guide also 
contains a heuristic proof of Theorem 9 for 2 x 2 matrices. 
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5 7 3 

1. The system is equivalent to Ax = b, where A = and b = . We compute 

"3 7l [5 3" 

4(b)= ,A 2 ( b)= , det = 6, det 4(b) = 5, det A 2 (b) = -l, 

_detJj(b)_5 _det^ 2 (b)_ 1 
Xl_ det J ~6’ Xl ~ det A ~~6' 

[ 4 li r 6i 

2. The system is equivalent to Ax = b, where A = $ ^ and b = .We compute 

"6 ll f 4 61 

4(b) = ^ ,A 2 (b)= $ , det A = 3, det 4 (b) = 5, det A 2 (b) = -2, 

_ det d, (b) _ 5 _ det A 2 (b) _ 2 

•Xi — — « •X') — — . 

det A 3 det A 3 


3-2 7 

3. The system is equivalent to Ax = b, where A = and b = .We compute 

|_-5 6J [-5J 

" 7 -2l r 3 7l 

4(b) = ,A 2 (b)= , det A = 8, det 4(b) = 32, det 4(b) = 20, 

-5 6 -5-5 


det 4 (b) _ 32 
det A 8 


JZ. . 

= — = 4,jc, = 


det A 2 (b) _ 20 _ 5 
det A 8 2 


4. The system is equivalent to Ax = b, where A = 


-5 3 

3 -1 


and b = . We compute 


-5 -1 


3 -5 


, det A = -4, det A 1 ( b) = 6, det 4 ( b ) = -2, 


det J[(b) _ 6 _ 3 _ det J 2 (b) _ -2 _ 1 

det A ~ -4 ~ 2 ,Xl ~ det A ~ -4~2' 


2 10 7 

5. The system is equivalent to Ax = b, where A = -3 0 1 and b = -8 . We compute 

0 1 2J -3 

"710] [27 0] [217 

4( b)= -8 0 1 ,A 2 ( b)= -3 -8 1 ,4(b)= -3 0 -8 

-3 1 2j |_ 0 -3 2J |_ 0 1—3 

det A = 4, det 4(b) = 6, det 4(b) = 16, det (b ) =—14, 


det4(b) _6_3 ^ _ det4(b) _16 ^ _ det 4(b) _ -14 _ 7 

det A 4 2 ’ 2 det A 4 3 det A 4 2 
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' 2 

1 

f 


' 4 

6. The system is equivalent to Ax = b, where A = 

-1 

0 

2 

and b = 

2 


3 

1 

3 


-2 



"4 11" 


"2 4 1" 


"21 4" 

4(b) = 

2 0 2 
-2 1 3 

j 4(b) = 

-12 2 
3-2 3 

j 4(b) = 

-10 2 
3 1 -2 


. We compute 


det A = 4, det A l (b) = -1 6, det A 2 (b) = 52, det A 3 (b) = -4, 


det A l (b) _ -1 6 _ _ det A 2 (b) _ 52 _ 1 ^ _ det A 3 (b) _ -4 

— — i . JC') — — — 1 j. Xi — — 

det A 4 " det A 4 det A 4 


7. The system is equivalent to Ax = b, where A = 


6s 4 
9 2s 


and b = 


5 

-2 


. We compute 


4(b) = 


5 4 

-2 2s 


, A 2 (b) = 


6s 5 
9 -2 


, det v4j (b ) = 10s + 8, det A 2 (b) = -12s -45. 


Since det A = 12 s 2 - 36 = 12(s 2 - 3) ^ 0 for s ^ ±v3 , the system will have a unique solution when 
s ^ ±s/3 . For such a system, the solution will be 


x, =- 


det A x (b) _ 1 Os + 8 
det A 


12(s 2 -3) 6(s 2 -3) 


5s + 4 _ detA 2 (b) _ —12s — 45 _ —4s — 15 

, x 2 = 


det A 


12(s 2 -3) 4(s 2 -3) 


8. The system is equivalent to Ax = b, where A = 


3s -5 
9 5s 


and b = 


. We compute 


4(b) = 


3 -5 

2 5s 


, A (b) = 


3s 3 
9 2 


det A x (b ) = 1 5s + 1 0, det A 2 (b) = 6s - 27. 


Since det A = 15s ? + 45 = 15(s ? + 3) ^ 0 for all values of s, the system will have a unique solution for all 
values of s. For such a system, the solution will be 

2s -9 

5 a 2 


detJ.(b) 15s + 10 3s + 2 detA(b) 6s -27 

X, = : = ; = ; ,X, =- 


det A 


1 5(s~ +3) 3(s +3) 


det A 


15(s“+3) 5(s +3) 


9. The system is equivalent to Ax = b, where A = 


s -2s 
3 6s 


and b = 


-1 

4 


We compute 


A( t>) = 


-1 -2s 

4 6s 


,A(b) = 


s -1 
3 4 


det A (b) = 2s, det A 2 (b) = 4s + 3. 


Since det A = 6 s + 6s = 6 s(s + 1) = 0 for s = 0, -1, the system will have a unique solution when s 0, -1. 
For such a system, the solution will be 


det 4(b) 2s 


1 


detA 2 (b) 4s + 3 


det A 


6 s(s + 1) 3(s + 1) 


det A 


10. The system is equivalent to Ax = b, where A = 


2s 1 
3s 6s 


6s (s + 1) 
and b = 


. We compute 


4(b)- 


1 1 
2 6s 


> 4(b) - 


2s 1 
3s 2 


det A (b) = 6s - 2, det A 2 (b) = s. 
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Since det A = \2s 2 - 3s = 3s(4s - 1) = 0 for s = 0,1/4, the system will have a unique solution when 
s ± 0,1/4. For such a system, the solution will be 


_ det 4, (b) _ 6^-2 

det A 3s(45 - 1) 


det A 2 (h) _ 


, A-2 


1 


det A 35(45-1) 3(45-1) 


11. Since det A = 3 and the cofactors of the given matrix are 


c„ = 


0 0 
1 1 


= 0 , 


Q 2 — 


3 0 

-1 1 


- 3, C 13 - 


3 0 

-1 1 


= 3, 


^21 ~ 


-2 -1 



0 -1 



0 

-2 

1 1 

= 1, 

to 

11 

-1 1 

= -l, 

^23 — 

-1 

1 


= 2 , 


C 31 - 


-2 -1 

0 0 


= 0, 


C 32 


0 -1 
3 0 


- 3, C 33 - 


0 -2 
3 0 


= 6 , 


adj A = 


“ 0 

1 

0“ 


1 _ 1 a — 

“ 0 

1/3 

0" 

-3 

-1 

-3 

and A 1 

-1 

-1/3 

-1 

— dCll JL — 

det A 

3 

2 

6 



1 

2/3 

2 


12 . Since det A = 5 and the cofactors of the given matrix are 


c„ = 


-2 1 
1 0 


= -1. c 12 =- 


2 1 
0 0 


- 0, C 13 - 


C 31 - 


adj A = 


1 3 

-2 1 

-13 7 

0 0 5 

2 -1 -4 


= 7, 


C32 — 


1 3 

2 1 



1 3 



1 

3 



C 21 — 

1 0 

= 3, 

Q 2 _ 

0 

0 

= 0, 

0>3 — 


and A 1 


I 


det A 


adj A = 


2 -2 
0 1 

1 1 
0 1 

1 1 

2 -2 

-1/5 3/5 7/5 

0 0 1 
2/5 -1/5 -4/5 


- 5, C 33 - 


= 2 , 


= -l. 


= — 4 , 


13 . Since det A = 6 and the cofactors of the given matrix are 


c u = 


C 21 — 


C 3 i - 


= -l, 


adj A = 


0 1 
1 1 

5 4 

1 1 

5 4 

0 1 

-1 -1 5 

1 -5 1 

1 7 -5 


= 5, 


Q 2 ~ 


— ^22 


1 1 
2 1 

3 4 

2 1 


= 1 , 


C 32 — 


3 4 
1 1 


C n - 


- 5, C 23 — 


1 0 
2 1 

3 5 

2 1 


= 1 , 


= 7, 


= 1 (' - 

'-33 


= -5, 


and A 1 = — - — adj A = 
det A 


3 5 

1 0 

-1/6 -1/6 5/6 

1/6 -5/6 1/6 

1/6 7/6 -5/6 
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14 . Since det A = — 1 and the cofactors of the given matrix are 


c„ = 


^21 ~ 


c 31 = 


2 1 
3 4 

6 7 

3 3 

6 7 

2 1 


= 5, 


C 12 — 


0 1 
2 4 


— 2, C 13 — 


0 2 
2 3 


= —4, 


= -3, C 22 = 


3 7 
2 4 


- _? C=- 

Z 1^23 


3 6 
2 3 


= 3, 


C32 — 


3 7 
0 1 


— 3, C 33 - 


3 6 
0 2 


= 6 , 


adjJ = 


5 

2 

-3 -8" 

-2 -3 

and A 1 = — - — ad \A = 

"-5 3 8" 

-2 2 3 

-4 

3 6 

det A 

4 -3 -6 


15 . Since det A = 6 and the cofactors of the given matrix are 


C n = 


1 0 
3 2 


= 2 C = - 


-1 0 

-2 2 


= 2 C = 

z., v ^ 13 


^21 — 


0 0 
3 2 


= 0, C 22 = 


3 0 

-2 2 


= 6 , 


C 3 i — 


0 0 
1 0 


- 0, C 31 - 


0 0 
1 0 


= 0, 


^23 ~ 


C33 - 


-1 1 

-2 3 

3 0 

-2 3 

3 0 

-1 1 


= -l, 

= -9, 

= 3, 


adj^ = 


“ 2 

0 

0“ 

and A 1 = — - — adi A = 

1/3 

0 

0" 

2 

6 

0 

1/3 

1 

0 




det A 




-1 

-9 

3 


-1/6 

-3/2 

1/2 


16 . Since det A = -9 and the cofactors of the given matrix are 


Qi = 


C21 — 


C 3 i - 


adj^ = 


-3 1 

0 3 

2 4 

0 3 

2 4 

-3 1 

-9 -6 14 

0 3-1 

0 0-3 


--9, C 12 =- 


— 6, C 22 — 


= 14, C 32 =- 


0 1 

0 3 

1 4 

0 3 

1 4 
0 1 


= 0 , 


= 3, 


Q3 — 


C23 — 


and A 1 = — - — adi A = 
det A 


0 -3 
0 0 

1 2 
0 0 

1 2 

0 -3 

1 2/3 -14/9 

0 -1/3 1/9 

0 0 1/3 


=-i, c 33 = 


= 0, 


= 0, 


= -3, 


17 . Let A = 


a b 
c d 


. Then the cofactors of A are C u = d = d, C 12 = -c = -c, 


C 2 \ = - b =-b, and C 22 = a =a . Thus adj^4 = 


d -b 
-c a 


. Since det A = ad- be. Theorem 8 gives that 


.4 _1 =— ^adjv4= 1 


det A 


ad -be 


d -b 
—c a 


. This result is identical to that of Theorem 4 in Section 2.2. 
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18 . Each cofactor of A is an integer since it is a sum of products of entries in A. Hence all entries in adj A 
will be integers. Since det A = 1, the inverse formula in Theorem 8 shows that all the entries in A~ l will 
be integers. 


19 . The parallelogram is determined by the columns of A = 
|det4| = |8| = 8. 

20 . The parallelogram is determined by the columns of A = 
|det4| = | — 7| = 7. 


, so the area of the parallelogram is 


-1 4 

3 -5 


, so the area of the parallelogram is 


21 . First translate one vertex to the origin. For example, subtract (-1, 0) from each vertex to get a new 
parallelogram with vertices (0, 0),(1, 5), (2, -4), and (3, 1). This parallelogram has the same area as the 

r 1 2 i 

original, and is determined by the columns of A = , so the area of the parallelogram is 


5 -4 


|det4| = |-14j = 14. 


22 . First translate one vertex to the origin. For example, subtract (0, -2) from each vertex to get a new 
parallelogram with vertices (0, 0),(6, 1),(— 3, 3), and (3, 4). This parallelogram has the same area as 

[6 -31 

the original, and is determined by the columns of A = , so the area of the parallelogram is 


1 3 


|det4| = |21| = 21. 


1 1 7 


23. The parallelepiped is determined by the columns of A = 0 2 1 , so the volume of the 


-2 4 0 


parallelepiped is |det4| = |22| = 22. 


"1 -2 -1 

24 . The parallelepiped is determined by the columns of A = 4 -5 2 , so the volume of the 


2 -1 


parallelepiped is |det4| =: |-15| = 15. 


25 . The Invertible Matrix Theorem says that a 3 x 3 matrix A is not invertible if and only if its columns are 
linearly dependent. This will happen if and only if one of the columns is a linear combination of the 
others; that is, if one of the vectors is in the plane spanned by the other two vectors. This is equivalent to 
the condition that the parallelepiped determined by the three vectors has zero volume, which is in turn 
equivalent to the condition that det 4 = 0. 


26. By definition, p + S is the set of all vectors of the form p + v, where v is in S. Applying T to a typical 
vector in p + S, we have T(p + v) = 71 p ) + T(x). This vector is in the set denoted by T( p ) + T(S). This 
proves that T maps the set p + S into the set T(p) + T(S). 

Conversely, any vector in T(p) + T(S) has the form Tip) + T(\) for some v in S. This vector may be 
written as T(p + v). This shows that every vector in 7 ( p) + T(S) is the image under T of some point 
p + v in p + S. 
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27. Since the parallelogram S is determined by the columns of 


-2 -2 
3 5 


= 1—41 = 4. The matrix A has det A = 


-2 -2 
of 

3 5 

6 -2 1 


, the area of S is 


= 6 . By Theorem 1 0, the area of T(S) is 


|det A \ {area of 5} = 6 • 4 = 24. 

Alternatively, one may compute the vectors that determine the image, namely, the columns of 

r n r 6 — 2~| [—2 — 2l f— 18 — 22l 

A bj b,l = 

L J -3 2 3 5 12 16 


The determinant of this matrix is -24, so the area of the image is 24. 


28. Since the parallelogram S is determined by the columns of 


4 0 

-7 1 


the area of S is 


4 0 

-7 1 


= 141 = 4. The matrix A has det A = 


= 5 . By Theorem 1 0, the area of T(S) is 


|det A \ {area of S} =5 • 4 = 20. 

Alternatively, one may compute the vectors that determine the image, namely, the columns of 


r , 7 2 4 0 14 2 

A[b { b, = 

L - J |_i 1JL- 7 lj I ." 3 1 

The determinant of this matrix is 20, so the area of the image is 20. 


29. The area of the triangle will be one half of the area of the parallelogram determined by Vj and v 2 . By 
Theorem 9, the area of the triangle will be (l/2)|det A\, where A = [ v , v 2 ]. 

30. Translate R to a new triangle of equal area by subtracting (x 3 ,y 3 ) from each vertex. The new triangle has 
vertices (0, 0), (x, —x 3 ,y l —y 3 ), and (x 2 -x 3 ,y 2 -y 3 ). By Exercise 29, the area of the triangle will be 


1 , 

— det 


x, — x, x 1 - X, 


T1-T3 T2-T3 


Now consider using row operations and a cofactor expansion to compute the determinant in the formula: 
fxi Ti 1] U~*3 y x -y 3 ol r 



Xj 

Ti 

f 


det 

x 2 

T 2 

1 

= det 


_x 3 

T3 

1 



By Theorem 5, 

A J X l~ X 3 T 1 -T 3 
det 

*2- *3 T2-T3 


x 3 y 3 1 


x, - x, x, - X, 


X 1 -X 3 y 3 -y 3 

x 2 - x 3 T2-T3 


[x 2 -x 3 y 2 -y 3 j LT1-T3 y 2-T3J 

So the above observation allows us to state that the area of the triangle will be 

,1 r .. .. „n| J U Ti 111 


1 . 

— det 


x, - X, X~j — X, 


T1-T3 T2-T3 


= - det ^2 T 2 1 

x 3 y 3 1 
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2 2 2 
X, X, X, 


31. a. To show that T(S) is bounded by the ellipsoid with equation — ^ ^ = 1 , let u = 

cr b c 


and let 


x = 


= Au . Then u l =x 1 /a, u 2 =x 2 /b , and u 3 = x 3 /c, and u lies inside S (or u 2 + u 2 + u 3 < 1 ) if 


2 2 2 
X, X, X, 


and only if x lies inside T(S) (or -TL + + -j < 1 ). 

a b c 

b. By the generalization of Theorem 10, 

{volume of ellipsoid} = {volume of T(S)} 


= | det A | • {volume of 5} = abc^= A ’ m ^ c 


32. a. A linear transformation T that maps 5 onto S' will map e, to v, , e 2 to v 2 , and e 3 to v 3 ; that is, 

T(e l ) = Vj , T( e 2 ) = v 2 , and T( e 3 ) = v 3 . The standard matrix for this transformation will be 
A = [T(<t { ) r(e 2 ) r(e 3 )] = [y 1 v 2 v 3 ], 

b. The area of the base of S is (1/2)(1)(1) = 1/2, so the volume of S is (1/3)(1/2)(1) = 1/6. By part a. 

T(S) = S' , so the generalization of Theorem 10 gives that the volume of S' is det T| { volume of S} = 
(l/6)|detzf|. 

33. [M] Answers will vary. In MATLAB, entries in B - inv(A) are approximately 10 '' or smaller. 

34. [M] Answers will vary, as will the commands which produce the second entry of x. For example, the 
MATLAB command is x2 = det ( [A ( : , 1 ) bA(:,3:4)])/ det (A) while the Mathematica 
command is x2 = Det [ {Transpose [A] [ [1] ], b, Transpose [A] [[3]], 

Transpose [A] [ [4] ] }] /Det [A] . 

35. [M] MATLAB Student Version 4.0 uses 57,771 flops for inv A and 14,269,045 flops for the inverse 
formula. The inv (A) command requires only about 0.4% of the operations for the inverse formula. 
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1. a. True. The columns of A are linearly dependent. 

b. True. See Exercise 30 in Section 3.2. 

c. False. See Theorem 3(c); in this case det 5 A = 5 3 det A . 



“2 0“ 


“1 0 " 

d. False. Consider A = 

0 1 

, B = 

0 3 


and A + B = 


3 

0 


0 

4 


e. False. By Theorem 6, det A 3 = 2 3 . 

f. False. See Theorem 3(b). 

g. True. See Theorem 3(c). 

h. True. See Theorem 3(a). 

i. False. See Theorem 5. 

j. False. See Theorem 3(c); this statement is false for n x n invertible matrices with n an even integer. 

k. True. See Theorems 6 and 5; det A r A = (det A) 2 . 
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1. False. The coefficient matrix must be invertible. 

m. False. The area of the triangle is 5. 

n. True. See Theorem 6; det A 3 = (det A) 3 . 

o. False. See Exercise 31 in Section 3.2. 

p. True. See Theorem 6. 



12 

13 

14 


12 

13 

14 







2. 

15 

16 

17 

= 

3 

3 

3 

= 0 







18 

19 

20 


6 

6 

6 








1 

a 

b + c 


1 

a 

b + c\ 



1 

a 

b + c 

3. 

1 

b 

a+c 

= 

0 

b-a 

a 

-b 

i 

0 

7 ? 

1 

II 

a ) 

0 

1 

-1 


1 

c 

a+b 


0 

c-a 

a 

—c 



0 

1 

-1 



a 

b 

c 


a 

b 

c 


a 

b 

c 

4. 

a + x 

b + x 

C + X 

= 

X 

X 

X 

= xy 

1 

1 

1 


a + y 

b + y 

c + y 


y 

y 

y 


1 

1 

1 


5. 


1 

0 


9 9 
9 9 


4 0 0 5 
9 0 3 9 


6 0 0 7 0 


= H) 


9 9 
4 0 
9 3 


= (-l)(-2)(3) 


4 5 
6 7 


6 0 7 0 



4 

0 

5 

= (—!)(— 2) 

9 

3 

9 


6 

0 

7 


= ( 1)( 2)(3)( 2) = -12 


6 . 


4 8 8 8 5 
0 10 0 0 
6 8 8 8 7 
0 8 8 3 0 
0 8 2 0 0 


= ( 1 ) 


4 8 8 
6 8 8 
0 8 3 


0 2 0 0 


= (1)(2) 

4 8 5 
6 8 7 

= (1)(2)( — 3) 

4 5 
6 7 


0 3 0 



= ( 1 )( 2 )(— 3 )(— 2 ) = 12 


7. Expand along the first row to obtain 
1 1 x y 


1 x 1 

1 x. 


Ti 

v 2 


= 1 


y i 

j 2 


-x 


y i 

t 2 


+ T 


1 x. 


= 0. This is an equation of the form ax + by + c = 0, 


and since the points (x,,^,) and (x 2 ,y 2 ) are distinct, at least one of a and b is not zero. Thus the 
equation 

is the equation of a line. The points (xj ,y x ) and (x 2 ,y 2 ) are on the line, because when the coordinates 
of one of the points are substituted for x and y, two rows of the matrix are equal and so the determinant 


is zero. 
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8. Expand along the first row to obtain 

1 x y 

' ' E Ei 


1 


= 1 


m 


-x 


1 Ei 
0 m 


+ E 


1 


x. 


0 1 


i Ei 

0 1 m 

rewritten as mx ] - y x - mx + y = 0, or y - y x = m(x - x, ). 


= \(mx x -y x )- x(m) + y (1) = 0. This equation may be 



1 

a 

a 2 


1 a 

a 2 


1 a 

a 2 

9. detr = 

1 

b 

b 2 

= 

0 b — a 

,2 2 

b -a 

= 

0 b — a 

(. b - a)(b + a) 


1 

c 

2 

C 


0 c — a 

2 2 

c -a 


0 c — a 

(■ c-a)(c + a ) 



1 

a 

2 

a 


1 

2 

a a 

( b-a)(c-a ) 

0 

1 

b + a 

"a 

1 

0 

'o' 

1 

-o 

II 

0 

i 

b + a 


0 

1 

c + a 


0 

0 

c-b 


(b - a)(c - a)(c - b) 


10. Expanding along the first row will show that / ( t ) = det V = c 0 + c x t + c 2 t + c 3 r\ By Exercise 9, 



1 

*i 

2 

Xi 


C 3 = 

1 

*2 

x 2 

= (*2 - Xl )(t 3 - X X )(x 3 - x 2 ) * 0 


1 

x 3 

A 



since x x , x 2 , and x 3 are distinct. Thus / ( t ) is a cubic polynomial. The points (x, , 0) , (x 2 ,0) , and (x 3 ,0) 
are on the graph of f since when any of x, , x 2 or x 3 are substituted for t, the matrix has two equal rows 
and thus its determinant (which is / (t)) is zero. Thus / (x ; ) = 0 for / = 1,2, 3. 


11. To tell if a quadrilateral determined by four points is a parallelogram, first translate one of the vertices to 
the origin. If we label the vertices of this new quadrilateral as 0, v, , v 2 , and v 3 , then they will be the 
vertices of a parallelogram if one of v 3 , v 2 , or v 3 is the sum of the other two. In this example, subtract 
(1,4) from each vertex to get a new parallelogram with vertices 0 = (0, 0), v 3 = (-2,1) , v 2 = (2,5) , and 
v 3 = (4,4) . Since v 2 = v 3 + v, , the quadrilateral is a parallelogram as stated. The translated 
parallelogram has the same area as the original, and is determined by the columns of 


A = [y i v 3 ] 


-2 

1 


4 

4 


, so the area of the parallelogram is |det A\ = 


| — 12 | = 12 . 


12. A 2 x 2 matrix A is invertible if and only if the parallelogram determined by the columns of A has 
nonzero area. 


1 


13. By Theorem 8, (adj A) A = A A = I . By the Invertible Matrix Theorem, adj A is invertible and 

det A 


(adj A)~ l = 


det A 


-A. 


14. a. Consider the matrix A, = 


A O 
O I,. 


where 1 <k<n and O is an appropriately sized zero matrix. We 


will show that det A k = det A for all 1 <k< n by mathematical induction. 
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First let k = 1 . Expand along the last row to obtain 

A ° = (_i)i' !+l)+( " +l) . i . det A = dct A. 
0 1 


det A, = det 


Now let 1 < k < n and assume that det A k _, = det A. Expand along the last row of A k to obtain 
~A 0~ 

P h_ 

and the determinant of the matrix in question is det A. 


det A k = det 


= H) 


( n+k)+(n+k ) 


• 1 • det A k _ ] = det A k _ x = det A. Thus we have proven the result, 


b. Consider the matrix A, = 


h o 

C, D 


where 1 < k < n, C k is an n x k matrix and O is an appropriately 


sized zero matrix. We will show that dct A k = dct D for all 1 <k< n by mathematical induction. 
First let k = 1 . Expand along the first row to obtain 


det A, =det 


= (-l) 1+1 • 1 • det £> = det £>. 


1 O 
C, D 

Now let 1 < k < n and assume that det A k , = det D. Expand along the first row of A k to obtain 


det A, = det 


h 


O 


C k D 


= (-l) 1+l • 1 • det A k _! = dct A k _ ] = det D. Thus we have proven the result, and the 


determinant of the matrix in question is det D. 
c. By combining parts a. and b., we have shown that 


det 


A O 
C D 


det 


V 


A O 
O I 


det 


V 


/ O 
C D 


= (dct d)(dct D). 


From this result and Theorem 5, we have 


det 


A B 
O D 


= det 


A B 
O D 


~\T 


= det 


A 1 


O 


b t d t 


= (det A t Xdet D T ) = (dct d)(dct D). 


a. Compute the right side of the equation: 


" I 

0~ 

' A 

B~ 


" A 

B 

_x 

I 

0 

Y 


XA 

XB + Y_ 


Set this equal to the left side of the equation: 

so that XA = C 


~A 

B~ 


" A 

B 

C 

D 


XA 

XB + Y 


XB + Y = D 


Since XA = C and A is invertible, X = CA \ Since XB + Y = D, Y = D-XB = D-CA l B . Thus by 
Exercise 14(c), 



~A 

B~ 


r i 

o~ 


~A 

B 

det 

C 

D 

= det 

3 

i 

i 

det 

0 

d-ca~'b 


= (detA)(det(D-CA- l B)) 


b. From part a., 


det 


A 

C 


= (det 4)(dct (D-CA~ l B)) = det [A(D - CA~ l B)] 


= det [AD -ACA~'B] = det [AD - CAA~ l B ] 
= det [AD-CB] 
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16. a. Doing the given operations does not change the determinant of A since the given operations are all 
row replacement operations. The resulting matrix is 

a-b -a + b 0 ... 0 

0 a-b -a + b ... 0 

0 0 a-b ... 0 

b b b ... a 

b. Since column replacement operations are equivalent to row operations on A T and dct A 1 = det A, the 
given operations do not change the determinant of the matrix. The resulting matrix is 


a-b 

0 

0 

0 

0 

a-b 

0 

0 

0 

0 

a-b 

0 

b 

2b 

3 b ... 

1 

7 

+ 


c. Since the preceding matrix is a triangular matrix with the same determinant as A, 
det A = (a- b) n ~ l ( a + (n - l)h). 

17. First consider the case n = 2. In this case 

a-b b b b 2 

det B= = a(a-b),detC = =ab-b, 

0 a b a 

so det A = det B + det C = a(a-b) + ab-b 2 = a 2 -b 2 = (a- b)(a + b) = (a-b) 2 ~ i (a + (2 - 1 )b) , and the 
formula holds for n = 2. 

Now assume that the formula holds for all (k - 1) x (k - 1) matrices, and let A, B , and C be kx k 
matrices. By a cofactor expansion along the first column, 

a b ... b 

det B = (a-b) ... . = (a-b)(a-b) k ~ 2 (a + (k-2)b) = (a-b) k ~ l (a + (k-2)b) 

b b ... a 

since the matrix in the above formula is a (k- 1) x (k- 1) matrix. We can perform a series of row 
operations on C to “zero out” below the first pivot, and produce the following matrix whose determinant 
is det C: 

~b b ... b 

0 a-b ... 0 

0 0 ... a-b_ 

Since this is a triangular matrix, we have found that det C = b(a - b) k ~ x . Thus 

det A = det B + det C = {a - b) k ~ l ( a + (k - 2 )b) + b{a - b) k ~ l = (a - b) k ~ l (a + (k - l)b), 

which is what was to be shown. Thus the formula has been proven by mathematical induction. 

18. [M] Since the first matrix has a = 3, b = 8, and n = 4, its determinant is 

(3 - 8) 4-1 (3 + (4 - 1)8) = (-5) 3 (3 + 24) = (— 125)(27) = -3375. Since the second matrix has a = 8, b = 3, 
and n = 5, its determinant is (8 - 3) 5-1 (8 + (5 - 1)3) = (5) 4 (8 + 12) = (625)(20) = 12,500. 
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19. [M] We find that 









1 

1 

1 

1 

1 




1 

1 

1 

1 






1 

1 

1 





1 

2 

2 

2 

2 




1 

2 

2 

2 






1 

2 

2 =1, 




= 1, 

1 

2 

3 

3 

3 




1 

2 

3 

3 






1 

2 

3 





1 

2 

3 

4 

4 




1 

2 

3 

4 
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2 

3 

4 

5 


Our conjecture then is that 


1 

1 

1 . 

. 1 


1 

2 

2 . 

. 2 


1 

2 

3 . 

. 3 

= 1 

1 

2 

3 . 

n 



To show this, consider using row replacement operations to “zero out” below the first pivot. The 
resulting matrix is 


“1 

1 

1 

1 

0 

1 

1 

1 

0 

1 

2 

2 

0 

1 

2 

n — 1 


Now use row replacement operations to “zero out” below the second pivot, and so on. The final matrix 
which results from this process is 

1 1 1 ... 1 

0 1 1 ... 1 

0 0 1 ... 1 

0 0 0 ... 1 

which is an upper triangular matrix with determinant 1 . 


20. [M] We find that 









1 

1 

1 

1 

1 




1 

1 

1 

1 






1 

1 

1 





1 

3 

3 

3 

3 




1 

3 

3 

3 






1 

3 

3 =6, 




= 18, 

1 

3 

6 

6 

6 




1 

3 

6 

6 






1 

3 

6 





1 

3 

6 

9 

9 




1 

3 

6 

9 













1 

3 

6 

9 

12 


Our conjecture then is that 


1 

1 

1 

1 

1 

3 

3 

3 

1 

3 

6 

6 

1 

3 

6 

... 3(/i-l) 
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To show this, consider using row replacement operations to “zero out” below the first pivot. The 
resulting matrix is 


"1 

1 

1 ... 

1 

0 

2 

2 ... 

2 

0 

2 

5 ... 

5 

0 

2 

5 ... 

3(w — 1) — 1_ 


Now use row replacement operations to “zero out” below the second pivot. The matrix which results 
from this process is 


“1 

1 

1 

1 

1 

1 

1 

0 

2 

2 

2 

2 

2 

2 

0 

0 

3 

3 

3 

3 

3 

0 

0 

3 

6 

6 

6 

6 

0 

0 

3 

6 

9 

9 

9 

0 

0 

3 

6 

9 

12 

... 3(/i-2)_ 


This matrix has the same determinant as the original matrix, and is recognizable as a block matrix of the 
form 






As in Exercise 14(c), the determinant of the matrix 




is (det J)(det D) = 2 det D. 


Since D is an (n — 2) x ( n - 2) matrix, 

1 1 1 1 ... 1 

1 2 2 2 ... 2 

det£> = 3"“ 2 1 2 3 3 ... 3 = 3''“ 2 (1) = 3''“ 2 

1 2 3 4 ... n — 2 


by Exercise 19. Thus the determinant of the matrix 




is 2 det = 2 • 3"“ 2 . 
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Vector 

Spaces 


4.1 SOLUTIONS 

Notes: This section is designed to avoid the standard exercises in which a student is asked to check ten 
axioms on an array of sets. Theorem 1 provides the main homework tool in this section for showing that a set 
is a subspace. Students should be taught how to check the closure axioms. The exercises in this section (and 
the next few sections) emphasize ", to give students time to absorb the abstract concepts. Other vectors do 
appear later in the chapter: the space of signals is used in Section 4.8, and the spaces P„ of polynomials are 
used in many sections of Chapters 4 and 6. 


1. a. If u and v are in V, then their entries are nonnegative. Since a sum of nonnegative numbers is 
nonnegative, the vector u + v has nonnegative entries. Thus u + v is in V. 

~2 


b. Example: If u = 


and c = -1 , then u is in Tbut cu is not in V. 



X 


X 


cx 

2. a. If u = 

y_ 

is in IT, then the vector cu = c 

_y_ 

~ 

cy. 


since xy > 0. 
b. Example: If u = 


-1 

-7 


and v = 


is in IT because ( cx)(cy ) = c~(xy) > 0 


. then u and v are in IT but u + v is not in IT. 


3. Example: If u = 


and c = 4, then u is in H but cu is not in H. Since H is not closed under scalar 
multiplication, El is not a subspace of 2 . 

4. Note that u and v are on the line L, but u + v is not. 



5. Yes. Since the set is Span {I 2 }, the set is a subspace by Theorem 1 . 
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6. No. The zero vector is not in the set. 

7. No. The set is not closed under multiplication by scalars which are not integers. 

8. Yes. The zero vector is in the set H. If p and q are in H, then (p + q)(0) = p(0) + q(0) = 0 + 0 = 0, 

so p + q is in H. For any scalar c, (cp)(0) = c ■ p(0) = c • 0 = 0, so cp is in H. Thus H is a subspace by 
Theorem 1. 


9. The set H= Span {v}, where v = 


1 

3 

2 


. Thus H is a subspace of 3 by Theorem 1 . 


10. The set H= Span {v}, where v = 


2 

0 

-1 


. Thus H is a subspace of 3 by Theorem 1 . 


11. The set W= Span {u, v}, where u = 


12. The set W= Span {u, v}, where u = 


"5‘ 


"2" 

1 

and v = 

0 

0 


1 

V 


" 3 

1 

and v = 

-1 

2 


-1 

0 


4 


. Thus W is a subspace of J by Theorem 1 . 


. Thus IF is a subspace of 4 by Theorem 1. 


13. a. The vector w is not in the set {v 1 ,v 2 ,v 3 } . There are 3 vectors in the set {vj,v 2 ,v 3 }. 

b. The set Span {v l5 v 2 ,v 3 } contains infinitely many vectors. 

c. The vector w is in the subspace spanned by {Vj , v 2 , v 3 } if and only if the equation 

jqvi + x 2 v 2 + a 3 v 3 = w has a solution. Row reducing the augmented matrix for this system of linear 
equations gives 


1 

2 

4 

3~ 


"1 

0 

0 

f 

0 

1 

2 

1 

~ 

0 

1 

2 

1 

-1 

3 

6 

2 


0 

0 

0 

0 


so the equation has a solution and w is in the subspace spanned by {v! , v 2 , v 3 } . 

14. The augmented matrix is found as in Exercise 13c. Since 


" 1 

2 

4 

8" 


"1 

0 

0 

0" 

0 

1 

2 

4 

~ 

0 

1 

2 

0 

-1 

3 

6 

7 


0 

0 

0 

1 


the equation x, v, + x 2 v 2 + x 3 v 3 = w has no solution, and w is not in the subspace spanned by 

{Vi,V 2 ,V 3 }. 

15. Since the zero vector is not in W, W is not a vector space. 

16. Since the zero vector is not in W, W is not a vector space. 
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17. Since a vector w in W may be written as 



L °J L ij L °J 


is a set that spans W. 

18. Since a vector w in W may be written as 

" 4] [3] TO" 

0 0 0 

w = a +b +c 

1 1 1 

_- 2 \ |_oJ |_ 1 



19. Let H be the set of all functions described by y(t) = c,cos cot + c 2 sin cot. Then H is a subset of the vector 
space V of all real-valued functions, and may be written as H = Span {cos cot, sin cot}. By Theorem 1, 

H is a subspace of V and is hence a vector space. 

20. a. The following facts about continuous functions must be shown. 

1. The constant function f(7) = 0 is continuous. 

2. The sum of two continuous functions is continuous. 

3. A constant multiple of a continuous function is continuous, 
b. Let H = {f in C[a, b]: f(a) = f(A)}. 

1. Let g (t) = 0 for all t in [a, b]. Then g (a) = g (b) = 0, so g is in H. 

2. Let g and h be in H. Then g (a) = g (b) and h(a) = h (b), and (g + h)(a) = g (a) + h (a) = 
g (b) + h(6) = (g + h)(6), so g + h is in H. 

3. Let g be in H. Then g (a) = g (b), and (cg)(a) = cg(a) = cg(b) = (cg)(b), so eg is in H. 

Thus H is a subspace of C[a, b ]. 

21. The set H is a subspace of M 2x2 . The zero matrix is in H, the sum of two upper triangular matrices is 
upper triangular, and a scalar multiple of an upper triangular matrix is upper triangular. 

22. The set H is a subspace of M, x4 . The 2x4 zero matrix 0 is in H because F0 = 0. If A and B are matrices 
in H, then F(A + B) = FA + FB = 0 + 0 = 0, so A + B is in H. If A is in FI and c is a scalar, then 

F(cA) = c(FA ) = cO = 0, so cA is in H. 
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23. a. False. The zero vector in V is the function f whose values f [t) are zero for all t in . 

b. False. An arrow in three-dimensional space is an example of a vector, but not every arrow is a vector. 

c. False. See Exercises 1, 2, and 3 for examples of subsets which contain the zero vector but are not 
subspaces. 

d. True. See the paragraph before Example 6. 

e. False. Digital signals are used. See Example 3. 

24. a. True. See the definition of a vector space. 

b. True. See statement (3) in the box before Example 1. 

c. True. See the paragraph before Example 6. 

d. False. See Example 8. 

e. False. The second and third parts of the conditions are stated incorrectly. For example, part (ii) does 
not state that u and v represent all possible elements of H. 

25. 2, 4 

26. a. 3 

b. 5 

c. 4 

27. a. 8 

b. 3 

c. 5 

d. 4 

28. a. 4 

b. 7 

c. 3 

d. 5 

e. 4 

29. Consider u + (-l)u. By Axiom 10, u + (-l)u = lu + (-l)u. By Axiom 8, lu + (-l)u = (1 + (-l))u = Ou. 
By Exercise 27, Ou = 0. Thus u + (-l)u = 0, and by Exercise 26 (-l)u = -u. 

30. By Axiom 10 u = lu. Since c is nonzero, c _1 c = 1 , and u = (c _1 c)u . By Axiom 9, 

(c _1 c)u = c _1 (cu) = c 1 0 since cu = 0. Thus u = c~ l 0 = 0 by Property (2), proven in Exercise 28. 

31. Any subspace H that contains u and v must also contain all scalar multiples of u and v, and hence must 
also contain all sums of scalar multiples of u and v. Thus //must contain all linear combinations of u 
and v, or Span {u, v} . 

Note: Exercises 32-34 provide good practice for mathematics majors because these arguments involve 
simple symbol manipulation typical of mathematical proofs. Most students outside mathematics might profit 
more from other types of exercises. 

32. Both H and K contain the zero vector of Fbecause they are subspaces of V. Thus the zero vector of V is 
in H n K. Let u and v be in H n K. Then u and v are in H. Since H is a subspace u + v is in H. Likewise 
u and v are in K. Since K is a subspace u + v is in K. Thus u + v is in H C\ K. Let u be in H n K. Then u 
is in H. Since H is a subspace cu is in H. Likewise v is in K. Since AT is a subspace cu is in K. Thus cu is 
in H n K for any scalar c, and H n K is a subspace of V. 
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The union of two subspaces is not in general a subspace. For an example in 2 let H be the x-axis and let 
K be the v-axis. Then both H and K are subspaces of 2 , but H u K is not closed under vector addition. 
The subset H u K is thus not a subspace of 2 . 

33. a. Given subspaces H and K of a vector space V, the zero vector of V belongs to H + K, because 0 is in 

both H and K (since they are subspaces) and 0 = 0 + 0. Next, take two vectors in H + K, say 
w, = u, + V| and w 2 =u 2 +v 2 where U[ and u 2 are in H, and Vj and v 2 are in K. Then 

Wj +w 2 =u 1 +v 1 +u 2 +V 2 =(Uj +U 2 ) + (Vj +v 2 ) 

because vector addition in V is commutative and associative. Now Uj + u 2 is in H and v, + v 2 is in K 
because H and K are subspaces. Thi s shows that Wj + w 2 is in H + K. Thus H + K is closed under 
addition of vectors. Finally, for any scalar c, 

CW, = c(ll, + Vj) = CU, + CV, 

The vector cu, belongs to H and cv, belongs to K, because H and K are subspaces. Thus, cw , 
belongs to H + K, so H + K is closed under multiplication by scalars. These arguments show that 
H + K satisfies all three conditions necessary to be a subspace of V. 

b. Certainly H is a subset of H + K because every vector u in H may be written as u + 0, where the zero 
vector 0 is in K (and also in H, of course). Since H contains the zero vector of H + K, and H is closed 
under vector addition and multiplication by scalars (because H is a subspace of V ), H is a subspace of 
H + K. The same argument applies when H is replaced by K, so K is also a subspace of H + K. 

34. Aproofthat H +K = Span{u 1 ,...,u p ,v 1 ,...,v } has two parts. First, one must show that H + K is 

a subset of Span{u 1 ,...,u i!7 ,v 1 ,...,v ? }. Second, one must show that Span{u 1 ,...,u / ,,v 1 ,...,v ? } is a subset 
of H + K. 

( 1 ) A typical vector H has the form qu, + . . . + c u and a typical vector in K has the form 

d l \ i + ... + d q \ q . The sum of these two vectors is a linear combination of u l5 ...,u ,v l5 ...,v and so 
belongs to Span{u 1 ,...,u p ,v 1 ,...,v 9 }. Thus H + Kis a subset of Span{u 1 ,...,u p ,v 1 ,...,v ? }. 

(2) Each of the vectors u l5 ...,u ,Vj,...,v belongs to H + K, by Exercise 33(b), and so any linear 

combination of these vectors belongs to H + K, since H + K is a subspace, by Exercise 33(a). Thus, 
Span{u 1 ,...,u p ,v 1 ,...,v 9 } is a subset of H + K. 

35. [M] Since 

7 -4 -9 -9l [ 1 0 0 15/2 

-4 5 4 7 0 1 0 3 

-2-1 4 4 ~ 0 0 1 11/2 

9-7-7 8_| |_0 0 0 0 

w is in the subspace spanned by {vj,v 2 , v 3 }. 

36. [M] Since 

5-5-9 6] [ 1 0 0 11/2 

8 8 -6 7 0 1 0 -2 

-5-9 3 1 ~ 0 0 1 7/2 

3 -2 -7 -4j [0 0 0 0 

y is in the subspace spanned by the columns of A. 
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37. [M] The graph of f(t) is given below. A conjecture is that f(t) = cos At. 



The graph of g (t) is given below. A conjecture is that g (t) = cos 6 1 . 



38. [M] The graph of f (t) is given below. A conjecture is that f(7) = sin 3 1. 



The graph of g (t) is given below. A conjecture is that g (t) = cos At. 



The graph of h(t) is given below. A conjecture is that h(t) = sin 5 1. 



-l 
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4.2 SOLUTIONS 


Notes: This section provides a review of Chapter 1 using the new terminology. Linear tranformations are 
introduced quickly since students are already comfortable with the idea from ! The key exercises are 
1 7-26, which are straightforward but help to solidify the notions of null spaces and column spaces. Exercises 
30-36 deal with the kernel and range of a linear transformation and are progressively more advanced 
theoretically. The idea in Exercises 7-14 is for the student to use Theorems 1, 2, or 3 to determine whether 
a given set is a subspace. 


1. One calculates that 


' 3 

-5 

-3" 

T 


"0" 

6 

-2 

0 

3 

= 

0 

-8 

4 

1 

-4 


0 


so w is in Nul A. 


2. One calculates that 


' 5 

21 

19" 

' 5" 


" 0 " 

13 

23 

2 

-3 

= 

0 

8 

14 

1 

2 


0 


so w is in NuU. 


U o] 


3. First find the general solution of Ax = 0 in terms of the free variables. Since 
"1 0 -7 6 0" 

0 1 4-2 0 

the general solution is x 1 = 7x 3 -6x 4 , x 2 =-4x 3 + 2x 4 , with x 3 and x 4 free. So 


x = 


*1 


' 7" 


"-6" 

x 2 


-4 


2 


= x 3 

1 

+ x 4 

0 

x 3 


x 4 


0 


1 


and a spanning set for Nul A is 



" 7" 


"-6" 



-4 


2 



1 

? 

0 



0 


1 



4. First find the general solution of Ax = 0 in terms of the free variables. Since 

, , r 1 -6 o 0 01 

[A 0 ~ 

L J 0 0 1 0 0 


the general solution is x ] = 6x 2 , x 3 = 0 , with x 2 and x 4 free. So 


*i 


“6“ 


“ 0 " 

x 2 


1 


0 


— x 2 

0 

+ x 4 

0 

x 3 



_x 4 _ 


0 


1 
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and a spanning set for Nul A is 



"6" 


“0‘ 



1 


0 



0 

9 

0 



0 


1 



5 . First find the general solution of^4x = 0 in terms of the free variables. Since 


u 


o] ~ 


i 

0 

0 


-2 

0 

0 


0 4 

1 -9 
0 0 


0 

0 

1 


0 

0 , 
0 


the general solution is x 1 = 2x 2 - 4x 4 , x 3 = 9x 4 , x 5 = 0 , with x 2 and x 4 free. So 


*1 


'2' 


'-4' 

x 2 


1 


0 

x 3 

= x 2 

0 

+ x 4 

9 

x 4 


0 


1 



0 


0 


and a spanning set for Nul A is 



"2" 


~-4 



1 


0 



0 

9 

9 



0 


1 



0 


0 



6 . First find the general solution of^4x = 0 in terms of the free variables. Since 


U o] 


10 6-810 
0 1-2 10 0 , 
0 0 0 0 0 0 


the general solution is x i = -6x 3 + 8x 4 -x 5 , x 2 = 2x 3 - x 4 , with x 3 , x 4 , and x 5 free. So 


x i 


-6 


“ 8" 


'-f 

x 2 


2 


-1 


0 

x 3 

= X i 

1 

+ x 4 

0 

+ x 5 

0 

X 4 


0 


1 


0 

_ X 5 _ 


_ 0 


0 


1 


and a spanning set for Nul A is 



'-6' 


" 8" 


'-f 



2 


-1 


0 



1 

9 

0 

9 

0 



0 


1 


0 



0 


0 


1 
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7. The set W is a subset of l" 3 . If W were a vector space (under the standard operations in I 3 ), then it 
would be a subspace of 3 . But W is not a subspace of 3 since the zero vector is not in W. Thus W is 
not a vector space. 

8. The set ITis a subset of 3 . If W were a vector space (under the standard operations in 3 ), then it 
would be a subspace of 3 . But W is not a subspace of 3 since the zero vector is not in W. Thus W is 
not a vector space. 


9. The set W is the set of all solutions to the homogeneous system of equations a - 2b - 4c = 0, 

“1 -2 -4 0“ 

2 0-1-3 


2a-c-3d = 0. Thus W= Nul A, where A = 
Theorem 2, and is a vector space. 


. Thus IT is a subspace of 4 by 


10. The set IT is the set of all solutions to the homogeneous system of equations a + 3b - c = 0, 


a + b + c-d = 0. Thus W = Nul A, where A = 
Theorem 2, and is a vector space. 


13-10 
11 1-1 


. Thus IT is a subspace of 4 by 


11. The set IT is a subset of R 4 . If W were a vector space (under the standard operations in R 4 ), then it 
would be a subspace of 4 . But W is not a subspace of 4 since the zero vector is not in W. Thus W is not 
a vector space. 

12. The set IT is a subset of F 4 . If IT were a vector space (under the standard operations in 4 ), then it would 
be a subspace of F 4 . But IT is not a subspace of R 4 since the zero vector is not in IT. Thus IT is not a 
vector space. 

13. An element w on IT may be written as 


w = c 

T 

0 

+ d 

~-6 

1 


"1 

0 

-6' 

1 

c 


1 


0 


1 

0 

d 


where c and d are any real numbers. So W= Col A where A = 

Theorem 3, and is a vector space. 

14. An element w on IT may be written as 


1 -6 


. Thus IT is a subspace of by 


w = a 

-f 

1 

+ b 

1 

1 

to to 


"-1 

1 

2 

-2 

a 


3 


-6 


3 

-6 

_b_ 


where a and b are any real numbers. So W= Col A where A = 


-1 


2 

1 -2 
3 -6 


. Thus IT is a subspace of 3 by 


Theorem 3, and is a vector space. 
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15 . An element in this set may be written as 



where r, s and t are any real numbers. So the set is Col A where A = 


0 

1 

4 

3 


2 

1 

1 

-1 



16 . An element in this set may be written 



where b , c and d are any real numbers. 



1 -1 0 

2 1 1 

the set is Col A where A = 

0 5-4 

0 0 1 


17 . The matrix A is a 4 x 2 matrix. Thus 

(a) Nul A is a subspace of 2 , and 

(b) Col A is a subspace of 4 . 

18 . The matrix A is a 4 x 3 matrix. Thus 

(a) Nul A is a subspace of] 3 , and 

(b) Col A is a subspace of 1 4 . 

19 . The matrix A is a 2 x 5 matrix. Thus 

(a) Nul A is a subspace of] 5 , and 

(b) Col A is a subspace of 1 2 . 

20 . The matrix A is a 1 x 5 matrix. Thus 

(a) Nul A is a subspace of 5 , and 

(b) Col A is a subspace of I 1 = I . 

21 . Either column of A is a nonzero vector in Col A. To find a nonzero vector in Nul A, find the general 
solution of Ax - 0 in terms of the free variables. Since 

"1 -3 0" 

0 0 0 

0 0 0’ 

0 0 0 


[A 0 ] 
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the general solution is x ] = 3x 2 , with x 2 free. Letting x 2 be a nonzero value (say x 2 =l) gives the 
nonzero vector 



which is in Nul A. 


22. Any column of A is a nonzero vector in Col A. To find a nonzero vector in Nul A, find the general 
solution of Ax - 0 in terms of the free variables. Since 


U o] 


“1 0 -7 6 0“ 

0 14-2 0J 


the general solution is x ] = 7 x 3 -6x 4 , x 2 = -4x, + 2x 4 , with x 3 and x 4 free. Letting x z and x 4 be 
nonzero values (say x 3 = x 4 = 1 ) gives the nonzero vector 



which is in Nul A. 


23. Consider the system with augmented matrix [ A w] . Since 


[A w] 


“1 -2 -1/3“ 

0 0 OJ 


the system is consistent and w is in Col A. Also, since 






w is in Nul A. 


24. Consider the system with augmented matrix [A w] . Since 

“1 0 1 - 1 / 2 “ 

[A w]~ 0 11/2 1 , 

0 0 0 0 

the system is consistent and w is in Col A. Also, since 



w is in Nul A. 


25. a. True. See the definition before Example 1. 

b. False. See Theorem 2. 

c. True. See the remark just before Example 4. 

d. False. The equation Ax - b must be consistent for even’ b. See #7 in the table on page 226. 

e. True. See Figure 2. 

f. True. See the remark after Theorem 3. 
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26. a. True. See Theorem 2. 

b. True. See Theorem 3. 

c. False. See the box after Theorem 3. 

d. True. See the paragraph after the definition of a linear transformation. 

e. True. See Figure 2. 

f. True. See the paragraph before Example 8. 


27. Let A be the coefficient matrix of the given homogeneous system of equations. Since Ax = 0 for 
3' 


x = 


lOx = 


2 

-1 
" 30 
20 
-10 
equations. 


, x is in NuL4. Since Nuld is a subspace of 3 , it is closed under scalar multiplication. Thus 


is also in NuM, and x, = 30 , x 2 =20 , x 3 =-10 is also a solution to the system of 


28. Let A be the coefficient matrix of the given systems of equations. Since the first system has a solution, 

'O' 

i 

is in CoL4. Since Col A is a subspace of 3 , it is closed under scalar 


the constant vector b = 


multiplication. Thus 5b = 
solution. 


0 

5 

45 


is also in Col A, and the second system of equations must thus have a 


29. a. Since ^40 = 0, the zero vector is in Col A. 

b. Since Ax + Aw = A(x + w),Ax + Aw is in Col A. 

c. Since c(Ax) = A(cx),cAx isinCol^4. 


30. Since T( 0 F ) = 0„- , the zero vector 0„- of W is in the range of T. Let T(x) and T( w) be typical elements in 
the range of T. Then since T(x) + T( w) = T(x + w),T(x) + T( w ) is in the range of T and the range of T is 
closed under vector addition. Let c be any scalar. Then since cT (x) = T (cx), cT (x) is in the range of T 
and the range of T is closed under scalar multiplication. Flence the range of T is a subspace of W. 


31. a. Let p and q be arbitary polynomials in 2 , and let c be any scalar. Then 


T(p+q) = 


(p +q)(0)" 


p(0) + q(0)' 


P(0)" 

_l_ 

q(0)" 

_(p+q)(i)_ 


_p(l) + q(l)_ 


_P(1)_ 

i 

q(i)_ 


= T(p) + r(q) 


and 


T(cp) = 


(cp)(0) 


p(0)" 

_(cp)(l)_ 

— c 

_p(l). 


= cT( p) 


so T is a linear transformation. 
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b. Any quadratic polynomial q for which q(0) = 0 and q(l) = 0 will be in the kernel of T. The 


polynomial q must then be a multiple of p(t) = t(t - 1). Given any vector 


in 2 , the polynomial 


p = x 1 + (x 2 -x { )t has p(0) = Xj and p(l) = x 2 . Thus the range of T is all of 2 . 

32. Any quadratic polynomial q for which q(0) = 0 will be in the kernel of T. The polynomial q must then 
be q = at + bt 2 . Thus the polynomials p 1 (t) = ? and p 2 (t) = r span the kernel of T. If a vector is in the 

a 


range of T, it must be of the form 
p(t) = a in P 2 . Thus the range of T is 


. If a vector is of this form, it is the image of the polynomial 
:a real!. 


33. a. For any A and B in M 2x2 and for any scalar c, 

T(A + B) = (A + B) + (A + B) t =A + B + A t +B t =(A + A t ) + (B + B t ) = T(A) + T(B) 
and 

T(cA) = ( cA) t = c(A r ) = cT(A) 
so T is a linear transformation. 

b. Let B be an element of M 2x2 with B r = B, and let A = \B. Then 

T(A) = A + A t = —B + (—B) t = —B + —B t =—B + —B = B 
2 2 2 2 2 2 

c. Part b. showed that the range of T contains the set of all B in M 2x2 with B l = B. It must also be 
shown that any B in the range of T has this property. Let B be in the range of T. Then B = T(A) for 
some A in M 2x2 . Then B = A + A T , and 

B t =(A + A t ) t =A t +(A t ) t =A t +A = A + A t =B 


so B has the property that B = B. 
a b 


d. Let A = 


d 


be in the kernel of T. Then T(A) = A + A = 0 , so 


a b 


a c 


2 a c + b 


"0 0 " 


+ 


— 


— 


c d 


b d 


b + c 2d 


0 0 


A + A = 


Solving it is found that a = d = 0 and c = -b . Thus the kernel of T is 
0 b 


-b 0 


: b real 


34. Let f and g be any elements in C[0, 1] and let c be any scalar. Then 7'(f) is the antiderivative F of f with 
F(0) = 0 and T{ g) is the antiderivative G of g with G(0) = 0. By the rules for antidifferentiation F + G 
will be an antiderivative of f + g, and (F + G)(0) = F(0) + G(0) = 0 + 0 = O.Thus T(f + g) = T(f) + T(g). 
Likewise cF will be an antiderivative of cf, and (cF)(0) = cF(0) = cO = 0. Thus T(cf) = cT(i), and Tis a 
linear transformation. To find the kernel of T, we must find all functions /in C[0,1] with antiderivative 
equal to the zero function. The only function with this property is the zero function 0, so the kernel of T 
is { 0 }. 
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35. Since (7 is a subspace of V, 0 , is in U. Since T is linear, T( 0 F ) = 0 W . So 0 W is in T(U). Let T(x) and 
T( y) be typical elements in T(U). Then x and y are in U, and since U is a subspace of V, x + y is also 
in U. Since T is linear, T(x) + T(y) = T(x + y). So T(x) + r(y) is in T(U), and T(U) is closed under 
vector addition. Let c be any scalar. Then since x is in U and U is a subspace of V, cx is in U. Since T is 
linear, T(cx) = cT(x) and cT(x) is in T( U ). Thus T( U) is closed under scalar multiplication, and T( U) is 
a subspace of W. 

36. Since Z is a subspace of W, 0 W is in Z. Since T is linear, T{ 0 F ) = 0 W . So 0 V is in U. Let x and y be 
typical elements in U. Then T(x) and 7'(y) are in Z, and since Z is a subspace of W, T(x) + T (y) is also in 
Z. Since T is linear, T(x) + T(y) = T(x + y). So T(x + y ) is in Z, and x + y is in U. Thus U is closed 
under vector addition. Let c be any scalar. Then since x is in U, T(x) is in Z. Since Z is a subspace of W, 
cT(x ) is also in Z. Since T is linear, cT (x) = T (cx) and T(cx ) is in T(U). Thus cx is in U and U is closed 
under scalar multiplication. Hence U is a subspace of V. 

37. [M] Consider the system with augmented matrix [A w]. Since 

1 0 0 -1/95 1/95 

0 1 0 39/19 -20/19 

0 0 1 267/95 -172/95 

0 0 0 0 0 

the system is consistent and w is in CoLL Also, since 
"7 6-4 llT ll [14 

-5-10-2 1 0 

Axv = = 

9-11 7-3-1 0 

19 -9 7 1 JL- 3 J [ 0 

w is not in NulZ. 

38. [M] Consider the system with augmented matrix \A w] . Since 

10-10 — 2" 

0 1-2 0-3 

0 0 0 1 1 ’ 

0 0 0 0 0 

the system is consistent and w is in CoLL Also, since 

“-8 5 -2 OYl] [0 

-5 2 1 -2 2 0 

Aw = = 

10 -8 6 -3 1 0 

3 -2 1 oJLoJ [o 




w is in NuLL 
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39. [M] 

a. To show that a 3 and a 5 are in the column space of B, we can row reduce the matrices [B a 3 ] and 


[B 


a 3 ] : 


[B 


[ B 


1001/3 
0101/3 
0 0 10 
0 0 0 0 

"10 0 10/3 

0 1 0 -26/3 

0 0 1 -4 

0 0 0 0 


Since both these systems are consistent, a 3 and a 5 are in the column space of B. Notice that the same 

conclusions can be drawn by observing the reduced row echelon form for A: 

"1 0 1/3 0 10/3" 

011/30 -26/3 

A~ 

0 0 0 1 -4 

0 0 0 0 0 


b. We find the general solution of Ax = 0 in terms of the free variables by using the reduced row echelon 
form of A given above: x x = (-l/3)x 3 -(10/3)x 5 , x 2 = ( — 1/3 )jc 3 + (26/3)x 5 , x 4 =4x 5 with x 3 and x 5 
free. So 


*1 


- — 1/3 - 


—10/ 3 

*2 


— 1/3 


26/3 

x 3 

= x 3 

1 

+ x 5 

0 

X 4 


0 


4 

_ X 5 _ 


0 


1 


and a spanning set for Nul A is 



'-1/3' 


"-10/ 3" 



-1/3 


26/3 



1 

5 

0 



0 


4 



0 


1 



c. The reduced row echelon form of A shows that the columns of A are linearly dependent and do not 
span ] 4 . Thus by Theorem 12 in Section 1.9, T is neither one-to-one nor onto. 


40. [M] Since the line lies both in H = Spanjv, , v 2 } and in K = Span{v 3 ,v 4 } , w can be written both as 
CjVi + c 2 v 2 and c 3 v 3 + c 4 v 4 . To find w we must find the c/s which solve qv, + c 2 v 2 - c 3 v 3 - c 4 v 4 = 0 . 
Row reduction of [V[ v 2 -v 3 -v 4 0] yields 


"5 

1 

-2 

0 

0“ 


“1 

0 

0 

-10/3 

0 " 

3 

3 

1 

12 

0 

~ 

0 

1 

0 

26/3 

0 

8 

4 

-5 

28 

0 


0 

0 

1 

-4 

0 
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so the vector of c/s must be a multiple of (10/3, -26/3, 4, 1). One simple choice is (10, -26, 12, 3), which 
gives w = 10vj -26v 2 =12v 3 +3v 4 = (24,-48,-24) . Another choice for w is (1, -2, -1). 


4.3 SOLUTIONS 

Notes: The definition for basis is given initially for subspaces because this emphasizes that the basis elements 
must be in the subspace. Students often overlook this point when the definition is given for a vector space (see 
Exercise 25). The subsection on bases for Nul A and Col A is essential for Sections 4.5 and 4.6. The 
subsection on “Two Views of a Basis” is also fundamental to understanding the interplay between linearly 
independent sets, spanning sets, and bases. Key exercises in this section are Exercises 21-25, which help to 
deepen students’ understanding of these different subsets of a vector space. 

1. Consider the matrix whose columns are the given set of vectors. This 3x3 matrix is in echelon form, and 
has 3 pivot positions. Thus by the Invertible Matrix Theorem, its columns are linearly independent and 
span JE 3 . So the given set of vectors is a basis for \ 

2 . Since the zero vector is a member of the given set of vectors, the set cannot be linearly independent 
and thus cannot be a basis for \ Now consider the matrix whose columns are the given set of vectors. 
This 3x3 matrix has only 2 pivot positions. Thus by the Invertible Matrix Theorem, its columns do 
not span 

3 . Consider the matrix whose columns are the given set of vectors. The reduced echelon form of this matrix 
is 

1 3 -3] [1 0 9/2 

0 2-5-01 -5/2 

-2 -4 lj [o 0 0 

so the matrix has only two pivot positions. Thus its columns do not form a basis for 3 ; the set of vectors 
is neither linearly independent nor does it span If 3 . 

4 . Consider the matrix whose columns are the given set of vectors. The reduced echelon form of this 
matrix is 

1 -7] [ 1 0 0 

3 5-010 

2 4 j |_0 0 1 

so the matrix has three pivot positions. Thus its columns form a basis for 3 . 

5 . Since the zero vector is a member of the given set of vectors, the set cannot be linearly independent and 
thus cannot be a basis for If 3 . Now consider the matrix whose columns are the given set of vectors. The 
reduced echelon form of this matrix is 


1 

-2 

0 

0 " 


"1 

0 

0 

0 " 

-3 

9 

0 

-3 

- 

0 

1 

0 

0 

0 

0 

0 

5 


0 

0 

0 

1 


so the matrix has a pivot in each row. Thus the given set of vectors spans 3 . 
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6. Consider the matrix whose columns are the given set of vectors. Since the matrix cannot have a pivot in 
each row, its columns cannot span 3 ; thus the given set of vectors is not a basis for \ The reduced 
echelon form of the matrix is 


1 

-4' 


"1 

0 " 

2 

-5 

~ 

0 

1 

-3 

6 


0 

0 


so the matrix has a pivot in each column. Thus the given set of vectors is linearly independent. 

7. Consider the matrix whose columns are the given set of vectors. Since the matrix cannot have a pivot in 
each row, its columns cannot span 3 ; thus the given set of vectors is not a basis for 3 . The reduced 
echelon form of the matrix is 


'-2 

6" 


"1 

0 " 

3 

-1 

~ 

0 

1 

0 

5 


0 

0 


so the matrix has a pivot in each column. Thus the given set of vectors is linearly independent. 

8. Consider the matrix whose columns are the given set of vectors. Since the matrix cannot have a pivot in 
each column, the set cannot be linearly independent and thus cannot be a basis for 3 . The reduced 
echelon form of this matrix is 


1 

0 

3 

0" 


“1 

0 

0 

-3/2' 

-4 

3 

-5 

2 

~ 

0 

1 

0 

-1/2 

3 

-1 

4 

-2 


0 

0 

1 

l/2_ 


so the matrix has a pivot in each row. Thus the given set of vectors spans 

9 . We find the general solution of Ax = 0 in terms of the free variables by using the reduced echelon 
form of A: 


"1 

0 

-3 

2' 


"1 

0 

-3 

2' 

0 

1 

-5 

4 

~ 

0 

1 

-5 

4 

3 

-2 

1 

-2 


0 

0 

0 

0 


So X| = 3 x 3 - 2x 4 , x 2 = 5x 3 - 4x 4 , with x 3 and x 4 free. So 




"3' 


~-2 

x 2 


5 


-4 


= *3 

1 

+ x 4 

0 

*3 


x 4 


0 


1 


and a basis for Nul A is 



"3~ 


~-2 



5 


-4 



1 

9 

0 



0 


1 
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10 . We find the general solution of Ax = 0 in terms of the free variables by using the reduced echelon 
form of A: 


1 

0 

-5 

1 

4' 


"1 

0 

-5 

0 

T 

-2 

1 

6 

-2 

-2 

~ 

0 

1 

-4 

0 

6 

0 

2 

-8 

1 

9 


0 

0 

0 

1 

-3 


So X| = 5 x 3 - 7x 5 , x 2 = 4x 3 - 6x s , x 4 = 3x 5 , with x 3 and x 5 free. So 



and a basis for Nul A is 



11 . Let A = [l 2 l] . Then we wish to find a basis for Nul A. We find the general solution of Ax - 0 in 
terms of the free variables: x = — 2 y - z with y and z free. So 



and a basis for Nul A is 



12 . We want to find a basis for the set of vectors in 2 in the line 5x -y = 0. Let A = [ 5 -l] . Then we wish 

to find a basis for Nul A. We find the general solution of Ax = 0 in terms of the free variables: y = 5x with 
x free. So 



and a basis for Nul A is 
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13 . Since B is a row echelon form of A, we see that the first and second columns of A are its pivot columns. 
Thus a basis for Col A is 



1 

i 


l 

1 



2 

9 

-6 



1 

1 

1 


1 

OO 

1 



To find a basis for Nul A, we find the general solution of Ax = 0 in terms of the free variables: 
JCj = -6x 3 -5x 4 , x 2 = (-5 / 2)x 3 - (3 / 2)x 4 , with x 3 and x 4 free. So 


*i 


-6' 


-5' 

X 2 


-5/2 


-3/2 


= x 3 

1 

+ x 4 

0 

x 3 



x 4 


0 


1 


and a basis for Nul A is 



-6 


-5" 



-5/2 


-3/2 



1 

9 

0 



0 


1 



14 . Since B is a row echelon form of A, we see that the first, third, and fifth columns of A are its pivot 
columns. Thus a basis for Col A is 



T 


-5" 


'-3' 



2 


—5 


2 



1 

9 

0 

9 

5 



3 


-5 


-2 



To find a basis for Nul A, we find the general solution of Ax = 0 in terms 
completing the row reduction of B to get: x, = -2x 2 - 4x 4 , x 3 = (7 / 5)jc 4 , 


of the free variables, mentally 
x 5 = 0, with x 2 and x 4 free. 


So 


*i 


"-2" 


' -4' 

*2 


1 


0 

X 3 

= x 2 

0 

+ x 4 

7/5 

x 4 


0 


1 

_-fr_ 


0 


0 


and a basis for Nul A is 



'- 2 ' 


' -4' 



1 


0 



0 

9 

7/5 



0 


1 



0 


0 
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15. This problem is equivalent to finding a basis for Col A, where A = [vj v 2 v 3 v 4 v 5 ]. Since the 
reduced echelon form of A is 


1 

0 

-3 

1 

2" 


"1 

0 

-3 

0 

4 

0 

1 

-4 

-3 

1 


0 

1 

-4 

0 

-5 

-3 

2 

1 

-8 

-6 


0 

0 

0 

1 

-2 

2 

-3 

6 

7 

9 


0 

0 

0 

0 

0 


we see that the first, second, and fourth columns of A are its pivot columns. Thus a basis for the space 
spanned by the given vectors is 



f 


' 0" 


r 



0 


1 


-3 



-3 

9 

2 

9 

-8 



2 


_-3_ 


_ 7_ 



16. This problem is equivalent to finding a basis for Col A, where A = [v, v 2 v 3 v 4 v 5 ]. Since the 
reduced echelon form of A is 


“1 

-2 

6 

5 

0“ 


“1 

0 

0 

-1 

-2' 

0 

1 

-1 

-3 

3 


0 

1 

0 

-3 

5 

0 

-1 

2 

3 

-1 


0 

0 

1 

0 

2 

1 

1 

-1 

-4 

1 


0 

0 

0 

0 

0 


we see that the first, second, and third columns of A are its pivot columns. Thus a basis for the space 
spanned by the given vectors is 



T 


~-2 


" 6 " 



0 


1 


-1 



0 

9 

-1 

9 

2 



1 


1 


-1 



17. [M] This problem is equivalent to finding a basis for Col A, where A = [v, v 2 v 3 v 4 v 5 ]. Since 
the reduced echelon form of A is 


8 

4 

-1 

6 

-f 


“1 

0 

0 

-1/2 

3" 

9 

5 

-4 

8 

4 


0 

1 

0 

5/2 

-7 

-3 

1 

-9 

4 

11 

~ 

0 

0 

1 

0 

-3 

-6 

-4 

6 

-7 

-8 


0 

0 

0 

0 

0 

0 

4 

-7 

10 

-7_ 


0 

0 

0 

0 

0 


we see that the first, second, and third columns of A are its pivot columns. Thus a basis for the space 
spanned by the given vectors is 



8" 


“ 4 


'-f 



9 


5 


-4 



-3 

9 

1 

9 

-9 



-6 


-4 


6 



0 


4 


-7_ 
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18. [M] This problem is equivalent to finding a basis for Col A, where A = [vj v 2 v 3 v 4 v 5 ]. Since 
the reduced echelon form of A is 


"-8 

8 

-8 

1 

-9" 


"1 

0 

5/3 

0 

4/3“ 

7 

-7 

7 

4 

3 


0 

1 

2/3 

0 

1/3 

6 

-9 

4 

9 

-4 

~ 

0 

0 

0 

1 

-1 

5 

-5 

5 

6 

-1 


0 

0 

0 

0 

0 

_-7 

7 

-7 

-7 

0 


0 

0 

0 

0 

0 


we see that the first, second, and fourth columns of A are its pivot columns. Thus a basis for the space 
spanned by the given vectors is 



1 

1 

oo 


1 

OO 


f 



7 


-7 


4 



6 

9 

-9 

9 

9 



5 


-5 


6 



1 

1 


1 


1 

1 



19. Since 4vj + 5v 2 - 3v 3 = 0, we see that each of the vectors is a linear combination of the others. Thus the 
sets {v 15 v 2 }, { Y j,v 3 }, and {v 2 ,v 3 } all span H. Since we may confirm that none of the three vectors is 

a multiple of any of the others, the sets {vj,v 2 }, { v , , v, } , and {v 2 ,v 3 } are linearly independent and thus 
each forms a basis for H. 

20. Since Vj -3v 2 +5v 3 = 0, we see that each of the vectors is a linear combination of the others. Thus the 
sets {v l5 v 2 }, {"Vj , v 3 } , and {v 2 ,v 3 } all span H. Since we may confirm that none of the three vectors is a 
multiple of any of the others, the sets { v , , v 2 }, {vj,v 3 }, and {v 2 ,v 3 } are linearly independent and thus 
each forms a basis for H. 

21. a. False. The zero vector by itself is linearly dependent. See the paragraph preceding Theorem 4. 

b. False. The set {b 1 ,...,b p } must also be linearly independent. See the definition of a basis. 

c. True. See Example 3. 

d. False. See the subsection “Two Views of a Basis.” 

e. False. See the box before Example 9. 

22. a. False. The subspace spanned by the set must also coincide with H. See the definition of a basis. 

b. True. Apply the Spanning Set Theorem to V instead of H. The space V is nonzero because the 
spanning set uses nonzero vectors. 

c. True. See the subsection “Two Views of a Basis.” 

d. False. See the two paragraphs before Example 8. 

e. False. See the warning after Theorem 6. 

23. LetA = [v! v 2 v 3 v 4 ]. Then A is square and its columns span 4 since 4 = Span{vj, v 2 , v 3 ,v 4 }. 

So its columns are linearly independent by the Invertible Matrix Theorem, and {v l5 v 2 ,v 3 ,v 4 } is a basis 
for R 4 . 

24. Let A = [vj ... \ n ] . Then A is square and its columns are linearly independent, so its columns span 

" by the Invertible Matrix Theorem. Thus {v lv ..,v„} is a basis for ". 
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25 . In order for the set to be a basis for H, {v 1 ,v 2 ,v 3 } must be a spanning set for //; that is, 

H = Span{v,,v 2 ,v 3 }. The exercise shows that His a subset of Span{v l5 v 2 ,v 3 }. but there are vectors in 
Span{v 1 ,v 2 ,v 3 } which are not in H ( 'vj and v 3 , for example). So H ^ Span{v l5 v 2 , v 3 }, and {v,,v 2 ,v 3 } 
is not a basis for H. 

26 . Since sin t cos t = (1/2) sin 2 1, the set {sin t, sin 2 1} spans the subspace. By inspection we note that this 
set is linearly independent, so {sin t, sin 2 t) is a basis for the subspace. 

27 . The set {cos cot , sin cot ) spans the subspace. By inspection we note that this set is linearly independent, 
so {cos cot, sin cot} is a basis for the subspace. 

28 . The set {e ~ ht , te~ hl ) spans the subspace. By inspection we note that this set is linearly independent, so 
{e ~ bt , te~ hl ) is a basis for the subspace. 

29 . Let A be the n x k matrix [ v , ... \ k ] . Since A has fewer columns than rows, there cannot be a pivot 

position in each row of A. By Theorem 4 in Section 1 .4, the columns of A do not span " and thus are not 
a basis for ft". 

30 . Let A be the n x k matrix [ v , ... \ k ] . Since A has fewer rows than columns rows, there cannot be a 

pivot position in each column of A. By Theorem 8 in Section 1.6, the columns of A are not linearly 
independent and thus are not a basis for ". 

31 . Suppose that {v ls ...,v } is linearly dependent. Then there exist scalars c l ,...,c p not all zero with 

c l \ 1 + ... + c p y p = 0. 

Since T is linear, 

T(c l y 1 + ... + c p \ p ) = c l T(\ l ) + ... + c p T(\ p ) 
and 

rfavj + ...+£,¥,) =r(0) = 0. 

Thus 

c 1 r(v 1 )+...+c p r(v p ) = o 

and since not all of the c, are zero, {7’(v l ),...,7’(v / J} is linearly dependent. 

32 . Suppose that {^(v!),...,^^ )} is linearly dependent. Then there exist scalars c l ,...,c p not all zero with 

c l T(y 1 ) + ... + c p T(\ p ) = 0. 

Since T is linear, 

T (cjVj + . . . + c p \ p ) = c l T(\ l ) + ... + CpT(\p) = 0 = T (0) 

Since T is one-to-one 

T(c l \ l + ... + c p Y p ) = T(0) 

implies that 

c l y l + ... + c p y p = 0. 

Since not all of the c i are zero, {v l5 ...,v } is linearly dependent. 
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33. Neither polynomial is a multiple of the other polynomial. So { p ! , p 2 } is a linearly independent set in 1 3 . 
Note: {p ! i p 2 } is also a linearly independent set in 2 since P[ and p 2 both happen to be in 2 . 

34. By inspection, p, = p 3 + p 2 , or Pj + p 2 - p 3 = 0 . By the Spanning Set Theorem, 

Span{pj,p 2 ,p 3 } = Span{p[,p ? } . Since neither p, nor p 2 is a multiple of the other, they are linearly 
independent and hence {p 3 , p 2 } is a basis for Spanjp^p^pj}. 


35. Let {v ls v 3 } be any linearly independent set in a vector space V, and let v 2 and v 4 each be linear 
combinations of v, and v 3 . For instance, let v 2 =5v, and v 4 =V! +v 3 . Then {vj,v 3 } is a basis for 
Span{v 1 ,v 2 ,v 3 ,v 4 }. 


36. [M] Row reduce the following matrices to identify their pivot columns: 


u i 


u i 


0 



1 

0 

2" 


"1 

0 

2" 

u 3 ] = 

2 

2 

2 


0 

1 

-1 

3 

-1 

7 


0 

0 

0 


-1 

1 

-3 


0 

0 

0 


1 

2 

-f 


“1 

0 

3' 

v 3 ] = 

0 

-2 

4 


0 

1 

-2 

8 

9 

6 


0 

0 

0 


-4 

-5 

-2 


0 

0 

0 





” 

1 

0 

2 




y 3 ] = 


2 

2 

2 

u 3 Vl 

v 2 


3 

-1 

7 





- 

1 

1 

-3 


, so {U[,u 2 } is a basis for H. 


so {v!,v 2 } is a basis for K. 


0 0 
0 0 


1 -1 
0 


0 

0 -3 


1 

0 0 


2 

-2 

9 

-5 

2 -4 

6 
3 
0 


-1 

4 

6 

-2 


so {UjjUjjVj} is a basis for H + K. 


37. [M] For example, writing 


• t + c 2 ■ sin t + c 3 cos 2 1 + c 4 sin t cos t = 0 


with t = 0, . 1 , .2, .3 gives the following coefficent matrix A for the homogeneous system Ac ~ 0 (to four 
decimal places): 


"0 

sin 0 

cos 0 

sin 0 cos 0 


"0 

0 

1 

0 

.1 

sin .1 

cos .2 

sin .1 cos .1 


.1 

.0998 

.9801 

.0993 

.2 

sin .2 

cos .4 

sin .2 cos .2 


.2 

.1987 

.9211 

.1947 

.3 

sin .3 

cos .6 

sin .3 cos .3 


.3 

.2955 

.8253 

.2823 


This matrix is invertible, so the system Ac = 0 has only the trivial solution and 
{t, sin t, cos 2 1, sin t cos t} is a linearly independent set of functions. 
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38. [M] For example, writing 

c, • 1 + c 2 - cost + c 3 - cos 2 ? + c 4 ■ cos 3 t + c 5 ■ cos 4 / 1 + c 6 • cos 5 ? + c 7 - cos 6 / 1 = 0 

with? = 0, .1, .2, .3, .4, .5, .6 gives the following coefficent matrix A for the homogeneous systemic = 0 
(to four decimal places): 


1 

cosO cos 2 0 

cos 3 0 

cos 4 0 

cos 5 0 

cos 6 0 

1 

cos.l cos 2 .l 

cos 3 . 1 

cos 4 .l 

cos 5 .l 

cos 6 .l 

1 

cos. 2 cos 2 . 2 

cos 3 .2 

4 o 

cos .2 

:os 5 .2 

cos 6 .2 

1 

cos. 3 cos 2 . 3 

cos 3 . 3 

cos 4 . 3 

cos 5 . 3 

cos 6 .3 

1 

cos. 4 cos 2 . 4 

cos 3 .4 

cos 4 . 4 

:os 5 .4 

cos 6 .4 

1 

cos. 5 cos 2 . 5 

cos 3 .5 

4 c 

cos .5 

:os 5 .5 

cos 6 . 5 

1 

cos. 6 cos 2 . 6 

cos 3 .6 

cos 4 . 6 

:os 5 .6 

cos 6 .6 

1 

1 1 

1 

1 1 

1 


1 

.9950 .9900 

.9851 .9802 .9753 

.9704 


1 

.9801 .9605 

.9414 .9226 .9042 

.8862 


1 

.9553 .9127 

.8719 .8330 .7958 

.7602 


1 

.9211 .8484 

.7814 .7197 .6629 

.6106 


1 

.8776 .7702 

.6759 .5931 .5205 

.4568 


1 

.8253 .6812 

.5622 .4640 .3830 

.3161 



This matrix is invertible, so the system Ac = 0 has only the trivial solution and 
{1, cos ?, cos 2 t, cos 3 / 1 , cos 4 ?, cos 5 / 1 , cos 6 ?} is a linearly independent set of functions. 


4.4 SOLUTIONS 


Notes: Section 4.7 depends heavily on this section, as does Section 5.4. It is possible to cover the ” parts of 
the two later sections, however, if the first half of Section 4.4 (and perhaps Example 7) is covered. The 
linearity of the coordinate mapping is used in Section 5.4 to find the matrix of a transformation relative to two 
bases. The change-of-coordinates matrix appears in Section 5.4, Theorem 8 and Exercise 27. The concept of 
an isomoiphism is needed in the proof of Theorem 17 in Section 4.8. Exercise 25 is used in Section 4.7 to 
show that the change-of-coordinates matrix is invertible. 


1. We calculate that 


x = 5 


3 

-5 


+ 3 


-4 

6 


2. We calculate that 
~4~ 


x = < 


+ (-5) 


3 

— 7 _ 

" 2 " 
5 ' 


3. We calculate that 


f 


5" 


' 4 


r-ii 

-4 

3 

+ 0 

(N (N ' 
1 

I 

+ (-l) 

1 

1 

O \1 
1 

— 

i 

i 

VO L/i 
1 


x = 3 
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4. We calculate that 


x = (-4) 

“-1" 

2 

+ 8 

“ 3“ 
-5 

+ (-7) 

1 

1 

-1^ 

1 

— 

“ 0“ 
1 


0 


2 


3 


-5 


5. The matrix [bj b 2 x] row reduces to 

6. The matrix [bj b 2 x] row reduces to 

7. The matrix [bj b 2 b 3 x] row reduces to 

8. The matrix [bj b 2 b 3 x] row reduces to 


“1 

0 

8“ 

, so [x] B = 

“ 8“ 

0 

1 

-5 

-5 

“1 

0 

-6 

, so [x] a = 

“-6“ 

0 

1 

2 

2 


1 0 0 - 1 " 

0 10-1 

0 0 13 

1 0 0 -2 

0 10 0 

0 0 15 


so [x] B = 


, so [x] 5 = 


-1 

-1 

3 

'- 2 ' 

0 

5 


9. The change-of-coordinates matrix from B to the standard basis in ' is 

2 f 


^=[b, b 2 ] = 


-9 


10. The change-of-coordinates matrix from B to the standard basis in ]' 3 is 

“ 3 2 8“ 

-1 0 -2 
4-5 7 


P B - [bj b 2 b 3 ] - 


11. Since P B 1 converts x into its ^-coordinate vector, we find that 


[x] B = P B ~\ = 


3 

—4 

-1 

“ 2“ 


-5 

6 


-6 



-3 -2 

-5/2 -3/2 


' 2 
-6 


12. Since P B 1 converts x into its ^-coordinate vector, we find that 


[x\ B = P B x = 


"4 6“ 

-1 

“2“ 


'-7/2 3“ 

“2“ 


“-7“ 

5 7 . 


0 


5/2 — 2_ 

0 


5_ 


13 . We must find c, , c 2 ,and c 3 such that 

Cj (1 + 1 ) + c 2 (t + 1 ) + c 3 (1 + 2f + 1 ~ ) = p(t) = 1 + 4f + It . 

Equating the coefficients of the two polynomials produces the system of equations 
c x + c 3 = 1 

c 2 + 2c 3 = 4 

q + c 2 + c 3 =7 
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We row reduce the augmented matrix for the system of equations to find 


“1 

0 

1 

f 


“1 

0 

0 

2 ' 


“ 2" 

0 

1 

2 

4 

~ 

0 

1 

0 

6 

» SO [p]/j = 

6 

1 

1 

1 

7 


0 

0 

1 

-1 


-1 


One may also solve this problem using the coordinate vectors of the given polynomials relative to the 
standard basis {1, t, t 2 }; the same system of linear equations results. 


14. We must find q , c 2 , and c 3 such that 

q (1 - t 2 ) + c 2 (t - r ) + c 3 (2 - 2t + 1 2 ) = p(t) = 3 + t - 6t 2 . 

Equating the coefficients of the two polynomials produces the system of equations 
c, + 2 c 3 = 3 

c 2 - 2c 3 = 1 

-q - c 2 + c 3 = -6 

We row reduce the augmented matrix for the system of equations to find 


1 

0 

2 

3" 


"1 

0 

0 

7 ' 


7' 

0 

1 

-2 

1 

~ 

0 

1 

0 

-3 

, so [p] B = 

-3 

-1 

-1 

1 

-6 


0 

0 

1 

-2 


-2 


One may also solve this problem using the coordinate vectors of the given polynomials relative to the 
standard basis {1, t, t 2 }; the same system of linear equations results. 


15. a. True. See the definition of the 5-coordinate vector. 

b. False. See Equation (4). 

c. False. 3 is isomoiphic to F 4 . See Example 5. 

16. a. True. See Example 2. 

b. False. By definition, the coordinate mapping goes in the opposite direction. 

c. True. If the plane passes through the origin, as in Example 7, the plane is isomoiphic to 2 . 


1 

17. We must solve the vector equation x l 
matrix for the system of equations to find 


+ X-, 


+ x-. 


-3 

7 


. We row reduce the augmented 


1 2 

-3 

f 


1 

O 

1 

5 " 

1 

1 

1 

OO 

7 

1 


0 1 1 

-2 


Thus we can let jc, = 5 + 5x 3 and x 2 = -2 - x 3 , where x 3 can be any real number. Letting x 3 = 0 and 


x 3 = 1 produces two different ways to express 


as a linear combination of the other vectors: 


5vj - 2v 2 and 1 0v, - 3v 2 + v 3 . There are infmtely many correct answers to this problem. 


18. For each k, b A = 0-bj H — + 1 - b A . H i-0-b,, , so [b A .] 5 =(0,...,l,...,0) = e A . 

19. The set S spans V because every x in V has a representation as a (unique) linear combination of elements 

in S. To show linear independence, suppose that S = {v l5 ...,v n } and that qv, H 1 -q,v„ =0 for some 

scalars q , . . ., c n . The case when q = • • • = c„ = 0 is one possibility. By hypothesis, this is the unique 
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(and thus the only) possible representation of the zero vector as a linear combination of the elements in S. 
So S is linearly independent and is thus a basis for V. 

20. For w in V there exist scalars k x , k 2 , k 3 , and k 4 such that 

w = k ] \ ] + k 2 \ 2 + ^ 3 V 3 + ^ 4 V 4 (1) 

because {v l5 v 2 , v 3 , v 4 } spans V. Because the set is linearly dependent, there exist scalars c, , c 2 , c 3 , and 
c 4 not all zero, such that 

0 = CjVj + c 2 v 2 + c 3 v 3 + c 4 v 4 (2) 

Adding (1) and (2) gives 

w = w + 0 = (k x + + (k 2 + c 2 )v 2 + (k 3 + c 3 )v 3 + (k 4 + c 4 )v 4 (3) 

At least one of the weights in (3) differs from the corresponding weight in (1) because at least one of the 
c, is nonzero. So w is expressed in more than one way as a linear combination of v, , v 2 , v 3 , and v 4 . 

21. The matrix of the transformation will be P B 

22. The matrix of the transformation will be P B 


1 

-2" 

-1 

"9 

2" 

-4 

9 


4 

1 


= [b, - b„r\ 


23. Suppose that 


[u] s =[w] B = 


By definition of coordinate vectors, 

U = W=C!b, + ••• + £?„ b„. 

Since u and w were arbitrary elements of F, the coordinate mapping is one-to-one. 


24. Given y = (y 1 ,...,y„) in ", let u = y 1 b 1 H — + y„b„ . Then, by definition, [u] s =y. Since y was 
arbitrary, the coordinate mapping is onto 


25. Since the coordinate mapping is one-to-one, the following equations have the same solutions q,. 
quj H — + c p u p = 0 (the zero vector in V) 

[quj H = [b] a (the zero vector in ") 

Since the coordinate mapping is linear, (5) is equivalent to 


0 


GlUiL? +- + c p \u p \ B 


0 


(4) 

(5) 

( 6 ) 


Thus (4) has only the trivial solution if and only if (6) has only the trivial solution. It follows that 
{Uj,...,u } is linearly independent if and only if {[u 1 ] fl ,...,[u /) ] B } is linearly independent. This result 

also follows directly from Exercises 31 and 32 in Section 4.3. 
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26. By definition, w is a linear combination of u l 5 ...,u p if and only if there exist scalars c x ,...,c such that 

w=c l u l + --- + c p u p (7) 

Since the coordinate mapping is linear, 

[w]*=c 1 [u 1 ] J +--- + c / ,[u p ] a (8) 

Conversely, (8) implies (7) because the coordinate mapping is one-to-one. Thus w is a linear 
combination of Uj,...,u if and only if [w] B is a linear combination of [u]j,...,[u] . 

Note: Students need to be urged to write not just to compute in Exercises 27-34. The language in the Study 
Guide solution of Exercise 3 1 provides a model for the students. In Exercise 32, students may have difficulty 
distinguishing between the two isomorphic vector spaces, sometimes giving a vector in 3 as an answer for 
part (b). 

27. The coordinate mapping produces the coordinate vectors (1, 0, 0, 1), (3, 1, -2, 0), and (0, -1, 3, -1) 
respectively. We test for linear independence of these vectors by writing them as columns of a matrix and 
row reducing: 

1 3 0] r 1 0 0 

0 1-1 010 

0-2 3 ~ 0 0 1 

1 0 -lj [o 0 0 

Since the matrix has a pivot in each column, its columns (and thus the given polynomials) are linearly 
independent. 

28. The coordinate mapping produces the coordinate vectors (1,0, -2, -3), (0, 1,0, 1), and (1,3, -2, 0) 
respectively. We test for linear independence of these vectors by writing them as columns of a matrix and 
row reducing: 

10 ll I" 1 0 1 

0 1 3 0 13 

-2 0 -2 ~ 0 0 0 

-3 1 Oj L° 0 0 

Since the matrix does not have a pivot in each column, its columns (and thus the given polynomials) are 
linearly dependent. 

29. The coordinate mapping produces the coordinate vectors (1, -2, 1, 0), (-2, 0, 0, 1), and (-8, 12, -6, 1) 
respectively. We test for linear independence of these vectors by writing them as columns of a matrix and 
row reducing: 

1 -2 - 8 ] [ 1 0 -6 

-2 0 12 0 1 1 

1 0 -6 ~ 0 0 0 

0 1 lj [o 0 0 

Since the matrix does not have a pivot in each column, its columns (and thus the given polynomials) are 
linearly dependent. 
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30. The coordinate mapping produces the coordinate vectors (1, -3, 3, -1), (4, -12, 9, 0), and (0, 0, 3, -4) 
respectively. We test for linear independence of these vectors by writing them as columns of a matrix and 
row reducing: 


1 

4 

0“ 


“1 

0 

4 

-3 

-12 

0 


0 

1 

-1 

3 

9 

3 


0 

0 

0 

-1 

0 

-4 


0 

0 

0 


Since the matrix does not have a pivot in each column, its columns (and thus the given polynomials) are 
linearly dependent. 


31. In each part, place the coordinate vectors of the polynomials into the columns of a matrix and reduce the 
matrix to echelon form. 



1 

-3 

-4 

f 


“1 

-3 

-4 

f 

a. 

-3 

5 

5 

0 

~ 

0 

-4 

-7 

3 


5 

-7 

-6 

-1 


0 

0 

0 

0 


Since there is not a pivot in each row, the original four column vectors do not span 3 . By the 
isomorphism between 3 and P 2 , the given set of polynomials does not span P 2 . 



“0 

1 

-3 

2“ 


“1 

-2 

2 

0 " 

b. 

5 

-8 

4 

-3 

~ 

0 

2 

-6 

-3 


1 

-2 

2 

0 


0 

0 

0 

7/2 


Since there is a pivot in each row, the original four column vectors span ! 3 . By the isomorphism 
between 3 and 2 , the given set of polynomials spans 2 . 


32. a. Place the coordinate vectors of the polynomials into the columns of a matrix and reduce the matrix to 



“1 

2 

f 


“1 

2 

f 

echelon form: 

0 

-1 

2 

~ 

0 

-1 

2 


1 

3 

-4 


0 

0 

-3 


The resulting matrix is invertible since it row equivalent to / 3 . The original three column vectors 
form a basis for 3 by the Invertible Matrix Theorem. By the isomorphism between T 3 and P 2 , the 
corresponding polynomials form a basis for Ip. 

b. Since [q] B =(-3, 1, 2), q = -3p, +p 2 + 2p 3 . One might do the algebra in 2 or choose to compute 


"1 

2 

f 

“-3" 


f 

0 

-1 

2 

1 

= 

3 

1 

3 

-4 

2 


-8 


This combination of the columns of the matrix corresponds to the same 


combination of p,, p 2 , and p 3 . So q(t) = 1 + 3t -8r . 


33. The coordinate mapping produces the coordinate vectors (3, 7, 0, 0), (5, 1, 0, -2), (0, 1, -2, 0) and 

(1, 16, -6, 2) respectively. To determine whether the set of polynomials is a basis for P 3 , we investigate 
whether the coordinate vectors form a basis for ’ 4 . Writing the vectors as the columns of a matrix and 
row reducing 


“3 

5 

0 

f 


“1 

0 

0 

2" 

7 

1 

1 

16 


0 

1 

0 

-1 

0 

0 

-2 

-6 


0 

0 

1 

3 

0 

-2 

0 

2 


0 

0 

0 

0 
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we find that the matrix is not row equivalent to / 4 . Thus the coordinate vectors do not form a basis for 
F 4 . By the isomorphism between i 4 and P 3 , the given set of polynomials does not form a basis for P 3 . 

34. The coordinate mapping produces the coordinate vectors (5, -3, 4, 2), (9, 1, 8 , - 6 ), ( 6 , -2, 5, 0), and 
(0, 0, 0, 1) respectively. To determine whether the set of polynomials is a basis for 3 , we investigate 
whether the coordinate vectors form a basis for ] 4 . Writing the vectors as the columns of a matrix, and 
row reducing 

5 9 6 0] [1 0 3/4 0 

-3 1-20 011/40 

4 8 5 0 ~ 0 0 01 

2-6 0 1 _| |_0 0 0 0 

we find that the matrix is not row equivalent to / 4 . Thus the coordinate vectors do not form a basis for 4 . 
By the isomoiphism between 4 and P 3 , the given set of polynomials does not form a basis for P 3 . 

35. To show that x is in H = Span{v l5 v 2 }, we must show that the vector equation jqv, + x 2 v 2 = x has a 
solution. The augmented matrix [v, v 2 x] may be row reduced to show 

11 14 19] [1 0 -5/3 

-5 -8 -13 0 1 8/3 

10 13 18 ~ 0 0 0 

7 10 I 5 J [o 0 0 

Since this system has a solution, x is in H. The solution allows us to find the 5-coordinate vector for .v: 
since x = x 1 v 1 +x 2 v 2 =(-5/3)v, +(8/3)v 2 , [x] B = 



36. To show that x is in H = Span{v l5 v 2 , v 3 } , we must show that the vector equation x, v, + x 2 v 2 + x 3 v 3 = x 
has a solution. The augmented matrix [v, v 2 v 3 x] may be row reduced to show 

-6 8 -9 4] f 1 0 0 3 

4 -3 5 7 0 1 0 5 

-9 7 -8 -8 ~ 0 0 1 2 

4-3 3 3 J [o 0 0 0 

The first three columns show that 5 is a basis for H. Moreover, since this system has a solution, x is in H. 
The solution allows us to find the 5-coordinate vector for x: since 

"3 

x = x, v, + x 2 v 2 + x 3 v 3 = 3vj + 5v 2 + 2v 3 , [x] B = 5 

2 


1/2 2.6 0 

37. We are given that [x] 5 = 1/4 , where 5 = < -1.5 , 3 


L1/6J IL °J L°J L 4 -* 

to the standard basis in 3 , we must find x. We compute that 


2.6 0 OYl/2] [ 1.3' 

x = 5 a [x] B = -1.5 3 0 1/4 = 0 . 

0 0 4.8 J [_1 / 6 J |_0.8 


To find the coordinates of x relative 
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"1/2" 



" 2.6" 


"0" 


O' 


38. We are given that [x] fl = 

1/2 

, where B = < 


-1.5 

? 

3 

9 

0 



1/3 



0 


0 


4.8 



to the standard basis in 3 , we must find x. We compute that 


To find the coordinates of x relative 


" 2.6 

0 

0 " 

"l/ 2 


1.3" 

-1.5 

3 

0 

1/2 

= 

0.75 

0 

0 

4.8 

1/3 


1.6 


4.5 SOLUTIONS 

Notes: Theorem 9 is true because a vector space isomoiphic to " has the same algebraic properties as a 
proof of this result may not be needed to convince the class. The proof of Theorem 9 relies upon the fact that 
the coordinate mapping is a linear transformation (which is Theorem 8 in Section 4.4). If you have skipped 
this result, you can prove Theorem 9 as is done in Introduction to Linear Algebra by Serge Lang (Springer- 
Verlag, New York, 1986). There are two separate groups of true-false questions in this section; the second 
batch is more theoretical in nature. Example 4 is useful to get students to visualize subspaces of different 
dimensions, and to see the relationships between subspaces of different dimensions. Exercises 31 and 32 
investigate the relationship between the dimensions of the domain and the range of a linear transformation; 
Exercise 32 is mentioned in the proof of Theorem 17 in Section 4.8. 



"f 


"-2" 

1. This subspace is H = Span{v l5 v 2 }, where v, = 

1 

and v 2 = 

1 


0 


3 


. Since Vj and v 2 are not multiples 


of each other, {v 1 ,v 2 } is linearly independent and is thus a basis for H. Hence the dimension of// is 2. 



' 4" 


" 0 " 

2. This subspace is H = Span{v l5 v 2 }, where v, = 

-3 

and v 2 = 

0 


0 


-1 


. Since v, and v 2 are not multiples 


of each other, { v' , , v 2 } is linearly independent and is thus a basis for H. Hence the dimension of// is 2. 



" 0 " 


" 0 " 


" 2" 


1 


-1 


0 

3. This subspace is H = Span{v 1 ,v 2 ,v 3 }, where v, = 

0 

. V 2 = 

1 

, and v 3 = 

-3 


1 


2 


0 


Theorem 4 in 


Section 4.3 can be used to show that this set is linearly independent: ^ 0, v 2 is not a multiple of v, , 

and (since its first entry is not zero) v 3 is not a linear combination of v, and v 2 . Thus {v 1 ,v 2 ,v 3 } is 
linearly independent and is thus a basis for H. Alternatively, one can show that this set is linearly 
independent by row reducing the matrix [vj v 2 v 3 0], Hence the dimension of the subspace is 3. 



"f 


1 " 


2 


0 

4. This subspace is H = Span{v l5 v 2 }, where v, = 

3 

and v 7 = 

-1 


0 


-1 


. Since v, and v 2 are not multiples 


of each other, {v l5 v 2 } is linearly independent and is thus a basis for H. Hence the dimension of H is 2. 
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f 


'-4' 


~-2 


2 


5 


-4 

5 . This subspace is H = Span{v 1 ,v 2 ,v 3 }, where Vj = 

-1 

> V 2 = 

0 

, and v 3 = 

2 


-3 


7 


6 


. Since v 3 = -2v, , 


{vj,v 2 , v 3 } is linearly dependent. By the Spanning Set Theorem, v 3 may be removed from the set with 
no change in the span of the set, so H = Span{v l5 v 2 }. Since v, and v 2 are not multiples of each other, 
{Vj, v 2 } is linearly independent and is thus a basis for H. Hence the dimension of H is 2. 



3" 


' 6" 


"-1" 


6 


-2 


-2 

6. This subspace is H = Span{v,,v 2 ,v 3 }, where v, = 

-9 

> V 2 = 

5 

, and v 3 = 

3 


-3 


1 


1 


v 3 = —(1 /3) v 3 , {vj,v 2 ,v 3 } is linearly dependent. By the Spanning Set Theorem, v 3 may be removed 
from the set with no change in the span of the set, so H = Span{V[,v 2 }. Since v, and v 2 are not 
multiples of each other, {v l5 v 2 } is linearly independent and is thus a basis for H. Hence the dimension 
of H is 2. 



"1 

-3 

f 


"1 

0 

0 

0 " 

7 . This subspace is H = Nul A, where A = 

0 

1 

-2 

. Since \A 0 ] ~ 

0 

1 

0 

0 


0 

2 

-1 


0 

0 

1 

0 


homogeneous system has only the trivial solution. Thus H = NulH = { 0 }, and the dimension of/f is 0. 

8. From the equation a - 2>b + c = 0, it is seen that (a, b,c,d) = b( 3, 1, 0, 0) + c(-l, 0, 1,0) + d( 0, 0, 0, 1). 
Thus the subspace is H = Span{v 1 ,v 2 ,v 3 }, where v 1 = (3, 1,0,0), v 2 = (-1,0, 1,0), and v 3 = (0,0, 0,1). It 
is easily checked that this set of vectors is linearly independent, either by appealing to Theorem 4 in 
Section 4.3, or by row reducing [v t v 2 v 3 0 ], Hence the dimension of the subspace is 3. 


9 . This subspace is H = 


a 



V 


“ 0 " 

b 

: a,b in 

> = Span{Vj,v 2 }, where v 3 = 

0 

and v 2 = 

1 

a 



1 


0 


. Since Vj and 


v 2 are not multiples of each other, }v, , v 2 } is linearly independent and is thus a basis for H. Hence the 
dimension of H is 2. 


10 . The matrix A with these vectors as its columns row reduces to 


“ 2 

-4 

-3' 


“1 

-2 

0 " 

-5 

10 

6 


0 

0 

1 


There are two pivot columns, so the dimension of Col A (which is the dimension of H) is 2. 
11. The matrix A with these vectors as its columns row reduces to 


“1 

3 

9 

-7' 


“1 

0 

-3 

2" 

0 

1 

4 

-3 

~ 

0 

1 

4 

-3 

2 

1 

-2 

1 


0 

0 

0 

0 


There are two pivot columns, so the dimension of Col A (which is the dimension of the subspace spanned 
by the vectors) is 2. 
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12. The matrix A with these vectors as its columns row reduces to 


1 

-3 

-8 

-3' 


"1 

0 

7 

0 " 

-2 

4 

6 

0 

~ 

0 

1 

5 

0 

0 

1 

5 

7 


0 

0 

0 

1 


There are three pivot columns, so the dimension of Col A (which is the dimension of the subspace 
spanned by the vectors) is 3. 

13. The matrix A is in echelon form. There are three pivot columns, so the dimension of Col A is 3. There 
are two columns without pivots, so the equation Ax - 0 has two free variables. Thus the dimension of 
Nul A is 2. 

14. The matrix A is in echelon form. There are three pivot columns, so the dimension of Col A is 3. There are 
three columns without pivots, so the equation Ax = 0 has three free variables. Thus the dimension of 
Nul A is 3. 

15. The matrix A is in echelon form. There are two pivot columns, so the dimension of Col A is 2. There 
are two columns without pivots, so the equation Ax = 0 has two free variables. Thus the dimension of 
Nul A is 2. 

16. The matrix A row reduces to 


3 

4' 


“1 

0 " 

-6 

10 


0 

1 


There are two pivot columns, so the dimension of Col A is 2. There are no columns without pivots, so the 
equationNx = 0 has only the trivial solution 0. Thus NulN = {0}, and the dimension of NulN is 0. 

17. The matrix A is in echelon form. There are three pivot columns, so the dimension of Col A is 3. There are 
no columns without pivots, so the equation Ax = 0 has only the trivial solution 0. Thus Nul A - [Of, and 
the dimension of Nul A is 0. 

18. The matrix A is in echelon form. There are two pivot columns, so the dimension of Col A is 2. There 
is one column without a pivot, so the equation Ax = 0 has one free variable. Thus the dimension of 
Nul A is 1. 

19. a. True. See the box before Example 5. 

b. False. The plane must pass through the origin; see Example 4. 

c. False. The dimension of „ is n + 1; see Example 1. 

d. False. The set S must also have n elements; see Theorem 12. 

e. True. See Theorem 9. 

20. a. False. The set 2 is not even a subset of II 3 . 

b. False. The number of free variables is equal to the dimension of Nul A; see the box before Example 5. 

c. False. A basis could still have only finitely many elements, which would make the vector space finite- 
dimensional. 

d. False. The set S must also have n elements; see Theorem 12. 

e. True. See Example 4. 
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21. The matrix whose columns are the coordinate vectors of the Hermite polynomials relative to the standard 
basis {1 ,?,? 2 ,? 3 } of] 3 is 

“ 10-2 0 

0 2 0 -12 

A = 

0 0 4 0 

0 0 0 8 

This matrix has 4 pivots, so its columns are linearly independent. Since their coordinate vectors form a 
linearly independent set, the Hermite polynomials themselves are linearly independent in 3 . Since there 
are four Hermite polynomials and dim P 3 = 4, the Basis Theorem states that the Hermite polynomials 
form a basis for 3 . 

22. The matrix whose columns are the coordinate vectors of the Laguerre polynomials relative to the 
standard basis {l,t,t 2 ,t 3 } of 3 is 

“112 6 

0 -1 -4 -18 

A = 

0 0 19 

0 0 0 -1 

This matrix has 4 pivots, so its columns are linearly independent. Since their coordinate vectors form a 
linearly independent set, the Laguerre polynomials themselves are linearly independent in P 3 . Since there 
are four Laguerre polynomials and dim 3 = 4, the Basis Theorem states that the Laguerre polynomials 
form a basis for P 3 . 

23. The coordinates of p(?) = 7-12?- 8 ? 2 +12 ? 3 with respect to B satisfy 

C[ (1) + c 2 (2?) + c 3 (—2 + 4 ? ) + c 4 (—12? + 8 ? ) — 7 — 12? — 8 ?” + 12?~ 

Equating coefficients of like powers of ? produces the system of equations 


C\ 

— 2 c 3 

= 

7 


2c 2 

- 12c 4 = 

-12 


4c 3 

II II 

O’ 

OO 

-8 

12 


Solving this system gives c, =3, c 2 =3, c 3 =-2, c 4 =3/2, and [p] 5 = 

3/2 

24. The coordinates of p(?) = 7 - 8? + 3? 2 with respect to B satisfy 

q (1) + c 2 (1 - ?) + c 3 (2 - 4? + ? 2 ) = 7 - 8? + 3 ? 2 
Equating coefficients of like powers of ? produces the system of equations 
q + c 2 + 2c 3 = 7 

— c 2 - 4c 3 = -8 

c 3 = 3 

5 

Solving this system gives c, =5, c 2 = -4, c 3 = 3, and [p] 5 = -4 

3 
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25. Note first that n > 1 since S cannot have fewer than 1 vector. Since n > 1, 0. Suppose that S spans V 

and that S contains fewer than n vectors. By the Spanning Set Theorem, some subset S' of S is a basis 
for V. Since S contains fewer than n vectors, and S' is a subset of S, S' also contains fewer than n 
vectors. Thus there is a basis S' for V with fewer than n vectors, but this is impossible by Theorem 10 
since dimV= n. Thus S cannot span V. 

26. If dimV= dim H = 0, then V= {0} and H= {0}, so H = V. Suppose that dim V= dim H> 0. Then// 
contains a basis S consisting of n vectors. But applying the Basis Theorem to V, S is also a basis for V. 
Thus H = V= SpanS. 

27. Suppose that dim =k<°°. Now „ is a subspace of for all n, and dim "*_i = k, so dim k -\ = dim . 
This would imply that f k _\ = , which is clearly untrue: for example p(t) = t k is in P but not in 

:>_i. Thus the dimension of cannot be finite. 

28. The space C(R) contains as a subspace. If C(R) were finite-dimensional, then would also be finite- 
dimensional by Theorem 11. But is infinite-dimensional by Exercise 27, so C(R) must also be infinite- 
dimensional. 

29. a. True. Apply the Spanning Set Theorem to the set {vj,...,v ; J and produce a basis for V. This basis 

will not have more than p elements in it, so d i m V < p. 

b. True. By Theorem 11, {vu^-jV } can be expanded to find a basis for V. This basis will have at least 
p elements in it, so dim V>p. 

c. True. Take any basis (which will contain p vectors) for V and adjoin the zero vector to it. 

30. a. False. For a counterexample, let v be a non-zero vector in ' 3 , and consider the set {v, 2v}. This is a 

linearly dependent set in 3 , but dim L 3 = 3 > 2 . 

b. True. If dxmV < p, there is a basis for V with p or fewer vectors. Thi s basis would be a spanning set 
for V with p or fewer vectors, which contradicts the assumption. 

c. False. For a counterexample, let v be a non-zero vector in ’ 3 , and consider the set {v, 2v}. This is a 
linearly dependent set in : 3 with 3-1=2 vectors, and dim ] 3 = 3 . 

3F Since H is a nonzero subspace of a finite-dimensional vector space V, H is finite-dimensional and has a 
basis. Fet {uj,...,u } be a basis for H. We show that the set {7 T (u 1 ),...,7 , (u )} spans T(H). Fet y be in 

T(H). Then there is a vector x in //with T(x) = y. Since x is in //and {u l5 .. .,u /( } is a basis for H, x may 

be written as x = CjU, +... + C u for some scalars c l ,...,c p . Since the transformation T is linear, 

y = 7'(x) = 7'(c l u l +... + c p u p ) = c l T(u l ) + ... + c p T(u p ) 

Thus y is a linear combination of r(u 1 ),...,r(u /) ) , and {r(u 1 ),...,r(u p )} spans T(H). By the Spanning 

Set Theorem, this set contains a basis for T(H). This basis then has not more than p vectors, and 
dim T(H) <p = dim H. 

32. Since H is a nonzero subspace of a finite-dimensional vector space V, H is finite-dimensional and has a 
basis. Fet {uj,...u p } be a basis for H. In Exercise 3 1 above it was shown that {r(uj),...,r(u p )} spans 

T(H). In Exercise 32 in Section 4.3, it was shown that [7’( u , ),..., 7’(u / ,)} is linearly independent. Thus 

{T (Uj ),..., 7’(u ;7 )} is a basis for T(H), and dim T{H) =p = dim H. 
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33. [M] 

a. To find a basis for 5 which contains the given vectors, we row reduce 


'-9 

9 

6 

1 

0 

0 

0 

0“ 


“1 

0 

0 

-1/3 

0 

0 

1 

3/7' 

-7 

4 

7 

0 

1 

0 

0 

0 


0 

1 

0 

0 

0 

0 

1 

5/7 

8 

1 

-8 

0 

0 

1 

0 

0 

~ 

0 

0 

1 

-1/3 

0 

0 

0 

-3/7 

-5 

6 

5 

0 

0 

0 

1 

0 


0 

0 

0 

0 

1 

0 

3 

22/7 

_ 7 

-7 

-7 

0 

0 

0 

0 

1 


0 

0 

0 

0 

0 

1 

-9 

-53/7_ 


The first, second, third, fifth, and sixth columns are pivot columns, so these columns of the 
original matrix ( {v t , v 2 , v 3 , e 2 , e 3 } ) form a basis for I 5 : 

b. The original vectors are the first k columns of A. Since the set of original vectors is assumed to 
be linearly independent, these columns of A will be pivot columns and the original set of vectors 
will be included in the basis. Since the columns of A include all the columns of the identity 
matrix, Col A = n . 

34. [M] 

a. The 5-coordinate vectors of the vectors in C are the columns of the matrix 


1 

0 

-1 

0 

1 

0 

-1 

0 

1 

0 

-3 

0 

5 

0 

0 

0 

2 

0 

-8 

0 

18 

0 

0 

0 

4 

0 

-20 

0 

0 

0 

0 

0 

8 

0 

-48 

0 

0 

0 

0 

0 

16 

0 

0 

0 

0 

0 

0 

0 

32 


The matrix P is invertible because it is triangular with nonzero entries along its main diagonal. 
Thus its columns are linearly independent. Since the coordinate mapping is an isomorphism, this 
shows that the vectors in C are linearly independent. 

b. We know that dim H = 7 because B is a basis for H. Now C is a linearly independent set, and 
the vectors in C lie in H by the trigonometric identities. Thus by the Basis Theorem, C is 
a basis for H. 


4.6 SOLUTIONS 

Notes: This section puts together most of the ideas from Chapter 4. The Rank Theorem is the main result in 
this section. Many students have difficulty with the difference in finding bases for the row space and the 
column space of a matrix. The first process uses the nonzero rows of an echelon form of the matrix. The 
second process uses the pivots columns of the original matrix, which are usually found through row reduction. 
Students may also have problems with the varied effects of row operations on the linear dependence relations 
among the rows and columns of a matrix. Problems of the type found in Exercises 1 9-26 make excellent test 
questions. Figure 1 and Example 4 prepare the way for Theorem 3 in Section 6.1; Exercises 27-29 anticipate 
Example 6 in Section 7.4. 
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1. The matrix B is in echelon form. There are two pivot columns, so the dimension of Col A is 2. There are 
two pivot rows, so the dimension of Row A is 2. There are two columns without pivots, so the equation 
Ax = 0 has two free variables. Thus the dimension of Nul A is 2. A basis for Col A is the pivot columns 
of A: 



1" 


"-4" 



-1 

9 

2 



5 


-6 



A basis for Row A is the pivot rows ofR: {(1,0, -1,5), (0,-2, 5, -6)}. To find a basis for Nul A row reduce 
to reduced echelon form: 


A~ 


1 0 
0 1 


-1 5 

-5/2 3 ‘ 


The solution to Ax = 0 in terms of free variables is x, = x 3 - 5x 4 , x 2 = (5 / 2)x 3 - 3x 4 with x 3 and x 4 
free. Thus a basis for Nul A is 



f 


'-5' 



5/2 


-3 



1 

9 

0 



0 


1 



2. The matrix B is in echelon form. There are three pivot columns, so the dimension of Col A is 3. There are 
three pivot rows, so the dimension of Row A is 3. There are two columns without pivots, so the equation 
Ax = 0 has two free variables. Thus the dimension of Nul A is 2. A basis for Col A is the pivot columns 
of A: 



f 


" 4 


9 



-2 


-6 


-10 



-3 

9 

-6 

9 

-3 



3 


4 


0 



A basis for Row A is the pivot rows of B: {(1,-3, 0,5, -7), (0,0, 2, -3, 8), (0,0, 0,0, 5)}. To find a basis for 

Nul A row reduce to reduced echelon form: 

"1 -3 0 5 0" 

0 0 1 -3/2 0 

A~ 

0 0 0 0 1 

0 0 0 0 0 


The solution to Ax = 0 in terms of free variables is x, = 3x 2 - 5x 4 , x 3 = (3 / 2)x 4 , x 5 = 0 , with x 2 and 
x 4 free. Thus a basis for Nul A is 



"3" 


' -5' 



1 


0 



0 

9 

3/2 



0 


1 



0 


0 
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3. The matrix B is in echelon form. There are three pivot columns, so the dimension of Col A is 3. There are 
three pivot rows, so the dimension of Row A is 3. There are two columns without pivots, so the equation 
Ax = 0 has two free variables. Thus the dimension of Nul A is 2. A basis for Col A is the pivot columns 
of A: 



A basis for Row A is the pivot rows of B: {(2, -3, 6, 2, 5), (0,0, 3, -1,1), (0,0, 0,1, 3)}. To find a basis for 
Nul A row reduce to reduced echelon form: 

"1 -3/2 0 0 -9/2 

0 0 1 0 4/3 

A~ 

0 0 0 1 3 

0 0 0 0 0 

The solution to Ax = 0 in terms of free variables is x l =(3/2)x 2 +(9/2)x 5 , jc 3 =-(4/3)jc 5 , x 4 =-3x 5 , 
with x 2 and x 5 free. Thus a basis for Nul A is 



4. The matrix B is in echelon form. There are three pivot columns, so the dimension of Col A is 3. There are 
three pivot rows, so the dimension of Row A is 3. There are three columns without pivots, so the equation 
Ax = 0 has three free variables. Thus the dimension of Nul A is 3. A basis for Col A is the pivot columns 
of A: 

"ii r i] r 7' 

1 2 10 

1 ,- 1 , i 

1 -3 -5 

lj |_ — 2 J [ 0 

A basis for Row A is the pivot rows of B\ 

{(1, 1, - 3, 7, 9, - 9), (0, 1, - 1, 3, 4, - 3), (0, 0, 0, 1, - 1, - 2)} . 

To find a basis for Nul A row reduce to reduced echelon form: 

"1 0 -2 0 9 2 

0 1-10 7 3 

A~ 0 0 0 1 -1 -2 

0 0 0 0 0 0 

0 0 0 0 0 0 
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The solution to Ax = 0 in terms of free variables is x t = 2x 3 - 9x s - 2x 6 , x 2 = x 3 - lx 5 - 3x 6 , 
x 4 = x 5 + 2x 6 , with x 3 , x 5 , and x 6 free. Thus a basis for Nul 4 is 

“2l [-91 [-2' 

1 -7 -3 

1 0 0 

O’ 1 ’ 2 

0 1 0 

_°J L °J U 

5. By the Rank Theorem, dimNul A = 8 - rank A = 8-3 = 5. Since dimRow A = rank A, di mR ow A = 3. 
Since ra nk A T = dimCol 4 r = dimRow A, ra nk .4 7 =3. 

6. By the Rank Theorem, dimNul A — 3 - rank A = 3-3 = 0. Since di mR ow A = rank A, di mR ow A = 3. 
Since rank A T = dimCol A T = dimRow A, rank A r =3. 

7. Yes, Col A - 4 . Since A has four pivot columns, dimCol A = 4. Thus Col A is a four-dimensional 
subspace of and Col A = 4 . 

No, Nul A ^ 3 . It is true that dimNul A = 3 , but Nul A is a subspace of 1 . 

8. Since A has four pivot columns, rank A = 4, and dimNul A = 6 — ra nk A = 6-4 = 2. 

No. Col A 4 . It is true that dimCol A = ra nk A = 4, but Col A is a subspace of 5 . 

9. Since dimNul A = 4, ra nk A = 6 — dimNul A = 6 — 4 = 2. So dimCol A = ra nk A = 2. 

10. Since dimNul A = 5, ra nk A = 6- dimNul ^4 = 6 — 5 = 1. So dimCol A = ra nk 4 = 1. 

11. Since dimNul 4 = 2, rank 4 = 5- dimNul 4 = 5-2 = 3. So dimRow 4 = dimCol 4 = rank 4 = 3. 

12. Since dimNul 4 = 4, rank 4 = 6- dimNul 4 = 6 - 4 = 2. So dimRow 4 = dimCol 4 = ra nk 4 = 2. 

13. The ra nk of a matrix 4 equals the number of pivot positions which the matrix has. If 4 is either a 7 x 5 
matrix or a 5x7 matrix, the largest number of pivot positions that 4 could have is 5. Thus the largest 
possible value for ra nk 4 is 5. 

14. The dimension of the row space of a matrix 4 is equal to rank 4, which equals the number of pivot 
positions which the matrix has. If 4 is either a 4x3 matrix or a 3x4 matrix, the largest number of pivot 
positions that 4 could have is 3. Thus the largest possible value for dimRow 4 is 3. 

15. Since the rank of 4 equals the number of pivot positions which the matrix has, and 4 could have at most 
6 pivot positions, rank 4 < 6. Thus dimNul 4 = 8 - rank 4 > 8-6 = 2. 

16. Since the ra nk of 4 equals the number of pivot positions which the matrix has, and 4 could have at most 
4 pivot positions, ra nk 4 < 4. Thus dimNul 4 = 4 - ra nk 4 > 4 - 4 = 0. 

17. a. True. The rows of 4 are identified with the columns of 4 r . See the paragraph before Example 1. 

b. False. See the warning after Example 2. 

c. True. See the Rank Theorem. 

d. False. See the Ra nk Theorem. 

e. True. See the Numerical Note before the Practice Problem. 
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18. a. False. Review the warning after Theorem 6 in Section 4.3. 

b. False. See the warning after Example 2. 

c. True. See the remark in the proof of the Ra nk Theorem. 

d. True. This fact was noted in the paragraph before Example 4. It also follows from the fact that the 
rows of A t are the columns of ( A 7 ) 1 = A. 

e. True. See Theorem 13. 

19. Yes. Consider the system as Ax = 0, where A is a 5x6 matrix. The problem states that dimNulA = 1 . 

By the Ra nk Theorem, ra nk A = 6 - dimNul A = 5. Thus dim Col A = ra nk A = 5, and since Col A is a 
subspace of 5 , Col A = 5 So every vector b in 5 is also in Col A, and Ax = b, has a solution for all b. 

20. No. Consider the system as Ax = b, where A is a 6x8 matrix. The problem states that dimNul A = 2. 

By the Ra nk Theorem, ra nk A = 8- dimNul A = 6. Thus dimCol A = ra nk A = 6, and since Col A is a 
subspace of 6 , Col A = 6 So every vector b in I 6 is also in Col A, and Ax = b has a solution for all b. 
Thus it is impossible to change the entries in b to make Ax = b into an inconsistent system. 

21. No. Consider the system as Ax = b, where A is a 9x10 matrix. Since the system has a solution for all b 
in 9 , A must have a pivot in each row, and so rankA = 9. By the Rank Theorem, dimNulA = 10-9 = 1. 
Thus it is impossible to find two linearly independent vectors in Nul A. 

22. No. Consider the system as Ax = 0, where A is a 10x12 matrix. Since A has at most 10 pivot positions, 
ra nk , 4 <10. By the Ra nk Theorem, dimNulA = 12 - ra nk A > 2. Thus it is impossible to find a single 
vector in Nul A which spans Nul A. 

23. Yes, six equations are sufficient. Consider the system as Ax = 0, where A is a 12x8 matrix. The 
problem states that dimNul A = 2. By the Ra nk Theorem, ra nk A = 8 - dimNul A = 6. Thus 

dimCol A = ra nk A = 6. So the system Ax = 0 is equivalent to the system Bx = 0, where B is an echelon 
form of A with 6 nonzero rows. So the six equations in this system are sufficient to describe the solution 
set of Ax = 0. 

24. Yes, No. Consider the system as Ax = b, where A is a 7x6 matrix. Since A has at most 6 pivot 
positions, rank A <6. By the Rank Theorem, dimNul A = 6 -rank A > 0. If dimNul A = 0, then the 
system Ax = b will have no free variables. The solution to Ax = b, if it exists, would thus have to be 
unique. Since ra nk A < 6, Col A will be a proper subspace of 1 . Thus there exists a b in T 7 for which 
the system Ax = b is inconsistent, and the system Ax = b cannot have a unique solution for all b. 

25. No. Consider the system as Ax = b, where A is a 10x12 matrix. The problem states that dimNulA = 3. 
By the Ra nk Theorem, dimCol A = ra nk A = 12 - dimNul A = 9. Thus Col A will be a proper subspace of 
1 10 Thus there exists a b in ] 10 for which the system Ax = b is inconsistent, and the system Ax = b 
cannot have a solution for all b. 

26. Consider the system Ax = 0, where A is a m x n matrix with m > n. Since the rank of A is the number of 
pivot positions that A has and A is assumed to have full rank, ra nk A = n. By the Ra nk Theorem, 
dimNul A = n - ra nk A = 0. So Nul A = {0}, and the system Ax = 0 has only the trivial solution. This 
happens if and only if the columns of A are linearly independent. 

27. Since A is an m x n matrix, Row A is a subspace of R", Col A is a subspace of and Nul A is a 
subspace of ”. Likewise since A 1 is an n x m matrix, Row A r is a subspace of ColA r is a 
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subspace of ", and N u 1 A 7 is a subspace of m . Since Row A = Col A 1 ' and Coi A = Row A r , there are 
four dinstict subspaces in the list: Row A, Co l A, Nul A, and NuU r . 

28. a. Since A is an m x n matrix and dimRow A = ra nk A, 

dimRow A + dimNul A = ra nk A + dimNul A = n. 
b. Since A T is an n x m matrix and dimCol A = dimRow A = dimCol A 7 = ra nk A T , 
dimCol A + dimNul A 7 = ra nk A T + dimNul A 7 = m. 


29. Let A be an m x n matrix. The system Ax = b will have a solution for all b in if and only if A has a 

pivot position in each row, which happens if and only if dimCol A = m. By Exercise 28 b., dimCol A = m 
if and only if dimNuM 7 = m - m = 0 , or Nul A 1 = {0} . Finally, Nul A 7 = {0} if and only if the equation 
A t x = 0 has only the trivial solution. 

30. The equation Ax = b is consistent if and only if ra nk [A b] = ra nk A because the two ranks will be 
equal if and only if b is not a pivot column of [A b]. The result then follows from Theorem 2 in 
Section 1 . 2 . 


31. Compute that uv r = 


' 2" 



2 a 

2b 

2c 

-3 

\a 

b c] = 

- 3a 

-3 b 

-3c 

5 



5 a 

5b 

5c 


. Each column of uv r is a multiple of u, so 


dimCol uv r = 1 , unless a = b = c = 0, in which case uv r is the 3x3 zero matrix and dimCol uv 7 = 0. 
In any case, ra nk uv r = dimCol uv r < 1 


32. Note that the second row of the matrix is twice the first row. Thus if v = (1, -3, 4), which is the first row 
of the matrix, 


uv 


T 



-3 4] 


1 -3 4 

2 - 68 ' 


33. Let A = [uj u 3 ], and assume that ra nk A = 1. Suppose that Uj ^ 0 . Then {uj is basis for Col A, 

since Col A is assumed to be one-dimensional. Thus there are scalars x and y with u 2 = vu, and 

r 

x . 

y 


u 3 = yu | , and A = u, v r , where v = 


If Uj = 0 but u 2 ^ 0 , then similarly {u 2 } is basis for Col A, since Col A is assumed to be one- 


dimensional. Thus there is a scalar x with u 3 = au 2 , and A = u 2 v , where v = 


If Uj = u 2 = 0 but u 3 ^ 0, then A = u 3 v r , where v = 


0 

0 

1 


34. Let A be an m x n matrix with of ra nk r > 0, and let Ube an echelon form of A. Since A can be reduced to 
U by row operations, there exist invertible elementary matrices E U ...,E with {E ■ ■ ■ E l )A = U. Thus 
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A = (E p ■ ■ ■ E X Y { U, since the product of invertible matrices is invertible. Let E = (E ■■■E l fr 1 ; then 
A=EU. Let the columns of E be denoted by c t , . . . , c m . Since the rank of A is r, U has r nonzero rows, 
which can be denoted df By the column-row expansion of A (Theorem 10 in Section 2.4): 

"df" 

A = EU = [ Cj ... c,„] d ^' =Cjdf +... + c r d T r , 

0 

which is the sum of r rank 1 matrices. 

35. [M] 

a. Begin by reducing A to reduced echelon form: 

“1 0 13/2 0 5 0 -3 

0 1 11/2 0 1/202 

A~ 0 0 0 1 -11/2 0 7 

0 0 0 0 0 1 1 

0 0 0 0 0 0 0 

A basis for Col A is the pivot columns of A, so matrix C contains these columns: 

"7-9 5-3 

-4 6 -2 -5 

C = 5 -7 5 2 

-3 5 -1 -4 

6-8 4 9 

A basis for Row A is the pivot rows of the reduced echelon form of A, so matrix R contains these 
rows: 

1 0 13/2 0 5 0 -3 

0 1 11/2 0 1/202 

00 01 -11/2 0 7 

0 0 0 0 0 1 1 

To find a basis for Nul A row reduce to reduced echelon form, note that the solution to Ax - 0 in 
terms of free variables is x, =-(13/ 2)x 3 - 5x 5 + 3x 7 , x 2 = —(1 1 / 2)x 3 - (1 / 2)x 5 - 2x 7 , 
x 4 =(11/2)x 5 -7x 7 , x 6 =-x 7 , with x 3 , x 5 , and x 7 free. Thus matrix A is 

"-13/2 -5 3 

-11/2 -1/2 -2 

1 0 0 

N= 0 11/2 -7 

0 1 0 

0 0-1 
0 0 1 
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b. The reduced echelon form of A T is 
“1 0 0 0 -2/11 

0100 -41/11 

0 0 10 0 
A T ~ 0 0 0 1 28/11 

0 0 0 0 0 

0 0 0 0 0 

0 0 0 0 0 

so the solution to A r x = 0 in terms of free variables is x x = (2/1 l)x 5 , x 2 = (41/1 l)x 5 , x 3 = 0, 
x 4 =-(28/11 )x 5 , with x 5 free. Thus matrix M is 

2/11 
41/11 
M= 0 
-28/11 
1 

The matrix S = ^R 1 /Vj is 7 x 7 because the columns of R r and N are in 7 and dimRow A + 

dimNul A = l. The matrix T = [C M ] is 5x5 because the columns of C and M are in 5 and 

dimCol A + dimNul A 1 = 5. Both S and T are invertible because their columns are linearly 
independent. This fact will be proven in general in Theorem 3 of Section 6.1. 

36 . [M] Answers will vary, but in most cases C will be 6 x 4, and will be constructed from the first 
4 columns of A. In most cases R will be 4 x 7, N will be 7 x 3, and M will be 6 x 2. 

37 . [M] The C and R from Exercise 35 work here, and A = CR. 

38 . [M] If A is nonzero, then A = CR. Note that CR = [Cr, Cr 2 . . . Cr n ] , where r, , . . ., r„ are the 
columns of R. The columns of R are either pivot columns of R or are not pivot columns of R. 

Consider first the pivot columns of R. The i th pivot column of R is e, , the / th column in the identity 
matrix, so Ce, is the i th pivot column of A. Since A and R have pivot columns in the same locations, 
when C multiplies a pivot column of R, the result is the corresponding pivot column of A in its proper 
location. 

Suppose r ■ is a nonpivot column of R. Then r ■ contains the weights needed to construct the j til column 
of A from the pivot columns of A, as is discussed in Example 9 of Section 4.3 and in the paragraph 
preceding that example. Thus r ■ contains the weights needed to construct the / ,h column of A from the 
columns of C, and Cr ; =a 
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4.7 SOLUTIONS 


Notes: This section depends heavily on the coordinate systems introduced in Section 4.4. The row reduction 
algorithm that produces P can also be deduced from Exercise 12 in Section 2.2, by row reducing [P c 
to I \P C l P B ■ The change-of-coordinates matrix here is interpreted in Section 5.4 as the matrix of the 
identity transformation relative to two bases. 


1. a. Since b 1 = 6 Cj -2c 2 and b 2 =9c 3 -4c 2 , [bj^ , [b 2 ] c = 


b. Since x = -3b[+2b 2 , [x] B = and 


6 9-3 0 

[X] c = P [X]n = = 

c c ^ b l 1B _2 -4 2 -2 


9 6 9 

, and P = 

-4 c^b -2 -4 


2. a. Since b 1 =-c,+4c 2 and b 2 =5c!-3c 2 , [bj c = 


b. Since x = 5b!+3b 2 , [x] B = and 


-1 5 5 

[Xl r = P [xln = 

L JC c<-« L 4-3 3 


5 -15 

, and P = 

-3 c^B 4 -3 


3. Equation (ii) is satisfied by P for all x in V. 

4 . Equation (i) is satisfied by P for all x in V. 


5. a. Since a[ = 4bj -b 2 , a 2 =-bj +b 2 +b 3 , and a 3 =b 2 -2b 3 , [aJ B = -1 , [a 2 \b = 


0 4-10 

[a, ] d = 1 , and P = -1 1 1 

B<~A 

-2 0 1-2 


b. Since x = 3a; +4a 2 +a 3 , [x] 4 = 4 and 


4-103 8 

[x] fl = P = -1 1 14 = 2 

£<-U 

0 1-21 2 



4.7 


Solutions 


229 


6. a. Since f, = 2d! -d 2 +d 3 , f 2 =3d 2 + d 3 , and f 3 = -3d, +2d 3 , [fj^ = 


" 2" 


" 0 " 


'-3' 

-1 

, [f 2 ]n = 

3 

, [f 3 ln = 

0 

1 


1 


2 


and P = 


2 0-3 

-13 0 

1 1 2 


b. Since x = f[ -2f 2 +2f 3 , [x] F = 


Mz> = P = 

D<—F 


1 

-2 

2 


and 


' 2 

0 

-3' 

f 


'-4' 

-1 

3 

0 

-2 

= 

-7 

1 

1 

2 

2 


3 


7. To find P , row reduce the matrix [c, c 2 b, b-,1: 


[Cl c 2 b! b 2 ] - 


10-31 
0 1-52 


Thus P = 

'-3 

r 

, and P = P 1 = 

'-2 

r 

C<-5 

-5 

2 

5<-C C<-5 

-5 

3 


8. To find P , row reduce the matrix [c , c 2 b, bJ: 

c<-s 


[Cl c 2 b! b 2 ] • 


10 3-2 

0 1-43 


Thus P = 

3 

-2 

, and P = P _1 = 

"3 

2" 

C<-5 

-4 

3 

5<-C C<-5 

4 

3 


9. To find P , row reduce the matrix [c, c 2 b, bJ: 

c^b L z 


[ci c 2 b! b 2 ] • 


10 9-2 

0 1-4 1 


Thus P = 

" 9 

-2" 

, and P = 

P * = 

"l 

2" 

C<-5 

-4 

1 

5<-C 

C^B 

_4 

9 


10. To find P , row reduce the matrix [c, c 2 b, bJ: 


Ci c 2 


bi b 2 ] 


10 8 3 

0 1-5-2 


Thus P = 

8 

3“ 

, and P = 

P l = 

" 2 

3" 

C<-5 

-5 

-2 

B<—C 

C<-5 

-5 

-8 


11. a. False. See Theorem 15. 

b. True. See the first paragraph in the subsection “Change of Basis in 
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12. a. True. The columns of P are coordinate vectors of the linearly independent set B. See the second 

paragraph after Theorem 15. 

b. False. The row reduction is discussed after Example 2. The matrix P obtained there satisfies 
[x] c =P[x] s 

13. Let B = {bj, b 2 , b 3 } = {\-2t + t 2 , 3-5t + 4r, 2t + 3t 2 } and let C = {c l5 c 2 , c 3 } = {1, t, t 2 }. The 
C-coordinate vectors of b[, b 2 , and b 3 are 

ll [3] [O' 

[bJc = — 2 5 [^2 lc = — ^ 11 [^3 lc = 2 

ij [ 4 J L 3 

So 

"1 3 0 

P = -2 -5 2 

c<-s 

1 4 3 

Let x = -1 +2 1. Then the coordinate vector [x] B satisfies 
"- 1 " 

^Mi=[x] c = 2 

C<-B 

0 

This system may be solved by row reducing its augmented matrix: 

1 3 0 -ll [ 1 0 0 5] [5 

-2 -5 2 2 ~ 0 1 0 -2 , so [x] B = -2 

1 4 3 0 0 0 0 1 1 


14. Let B = {bj, b 2 , b 3 } = {l-3t 2 , 2 + t-5t 2 , \ + 2t) andlet C = {c 15 c 2 ,c 3 } = {1, t, t 2 }. The C-coordinate 
vectors of b, , b 2 , and b 3 are 

il [21 [f 

[bile = ® ’[b2]c = 1 - [1*3 lc = 2 

-3J [-5] [0 

So 

“1 2 1 " 

P = 0 12 

C<-B 

-3 -5 0 

Let x = r. Then the coordinate vector [x] B satisfies 


P 

C^B 


M*=[x] 


c 


0 

0 

1 
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This system may be solved by row reducing its augmented matrix: 


1 

2 

1 

0“ 


“1 

0 

0 

3“ 


3" 

0 

1 

2 

0 

~ 

0 

1 

0 

-2 

,so [x] a = 

-2 

-3 

-5 

0 

1 


0 

0 

0 

1 


1 


and t 2 = 3(1 - 3? 2 ) - 2(2 + ? - 5? 2 ) + (1 + 2?). 


15. (a) B is a basis for V 

(b) the coordinate mapping is a linear transformation 

(c) of the product of a matrix and a vector 

(d) the coordinate vector of v relative to B 


16. (a) [bj c — Q\yi l \ B — Q 


= Q*\ 


(b) [b,] c 

( c ) [b /f ] c = Q\\ b/ f ]a = Qe k 

17. [M] 

a. Since we found P in Exercise 34 of Section 4.5, we can calculate that 



“32 

0 

16 

0 

12 

0 

10 


0 

32 

0 

24 

0 

20 

0 

P~ l = — 

0 

0 

16 

0 

16 

0 

15 

0 

0 

0 

8 

0 

10 

0 

32 

0 

0 

0 

0 

4 

0 

6 


0 

0 

0 

0 

0 

2 

0 


0 

0 

0 

0 

0 

0 

1 


b. Since P is the change-of-coordinates matrix from C to B, P 1 will be the change-of-coordinates 
matrix from B to C. By Theorem 15, the columns of P 1 will be the C-coordinate vectors of the 
basis vectors in B. Thus 


2 , 1 


cos'? = — (1 + cos 2 ?) 
2 


cos 3 ? = — (3cos t + cos 3 1) 
cos 4 ? = — (3 + 4cos 2? + cos At) 


cos 5 ? = — (10 cos ? + 5cos 3? + cos 5?) 

16 

cos 6 ? =— (10 + 15cos 2? + 6cos 4? + cos 6?) 
32 
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18. [M] The C-coordinate vector of the integrand is (0, 0, 0, 5, -6, 5, -12). Using P 1 from the previous 
exercise, the B- coordinate vector of the integrand will be 

P~\ 0, 0, 0, 5,-6, 5, -12) = (-6,55/8, -69/8, 45/16,-3,5/16,-3/8) 

Thus the integral may be rewritten as 

r ^ 55 69 . 45 - -.5 _ 3 , , 

-6h cost cos 2t H cos it -3cos 4 t-i cos 5 1 — cos 6 tclt, 

J 8 8 16 16 8 


which equals 


. 55 . 69 . - 15 . 3 . . 1 . , \ r „ 

-6 1 H sin t sm 2 1 H sm it sm 4 1 H sm 5 1 sm 6t + C . 

8 16 16 4 16 16 


19. [M] 

a. If C is the basis {v 1 ,v 2 ,v 3 }, then the columns of P are [Uj] c , [u 2 ] c , and [u 3 ] c . So 
u =[v 3 v 2 V 3 ] [ u 1 9 and [ u i u 2 u 3 ] = [vj v 2 v 3 ] P. In the current exercise, 


"-2 

-8 

-7' 

1 

2 

-f 


'-6 

-6 

-5' 

2 

5 

2 

-3 

-5 

0 

= 

-5 

-9 

0 

3 

2 

6 

4 

6 

1 


21 

32 

3 


b. Analogously to part 

a., [vj 

v 2 

V 3. = 

Wi 

w 2 

w 3 

]P> 

so [w, w 2 w 3 ] 

K v 2 v 3 ]i>-‘. 

In the current 

exercise, 







“-2 

-8 

-7' 

1 

2 

-1" 

-1 

[wi w 2 

w 3 ] = 

2 

5 

2 

-3 

-5 

0 




3 

2 

6 

4 

6 

1 



"-2 

-8 

-7' 

5 

8 

5“ 


"28 

38 

21" 

2 

5 

2 

-3 

-5 

-3 

= 

-9 

-13 

-7 

3 

2 

6 

-2 

-2 

-1 


-3 

2 

3 


20. a. P = P P 

D<~B D<^CC<^B 

Let x be any vector in the two-dimensional vector space. Since P is the change-of-coordinates 

c<-b 

matrix from B to C and P is the change-of-coordinates matrix from C to D, 

D<^C 

Me = p Mb and Mz> = P Me = P P Mb 

C^B n<-C D^CC^B 

But since P is the change-of-coordinates matrix from B to D, 

D^B 

Mb = P Mb 


Thus 


P Mb = P P Mb 

D<~B D*~C C*~B 

for any vector [x] B in fl 2 , and 


P = P P 

D^B D^CC^B 
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b. [M] For example, let B = 



and D = 




j. Then we 


can calculate the change-of-coordinates matrices: 


1 

-2 

7 

-3" 


"1 

0 

-3 

f 

=> P = 

"-3 

r 

-5 

2 

5 

-1 


0 

1 

-5 

2 

C<-£ 

-5 

2 


'-1 1 1 -2" 


"10 0 

-8/3' 

=> P = 

"0 

-8/3" 

(N ' 

i r) 

1 

i D 
1 

(X) 


0 1 1 

—14/3 

D<-C 

l 

-14/3 


"-1 1 7 

-3" 


"1 0 40/3 

-16/3" 

=> P = 

"40/3 

-16/3" 

i n 

i r) 
1 

oo 

-1 


0 1 61/3 

-25/3 

D^B 

61/3 

-25/3 


One confirm s easily that 


"40/3 

-16/3" 


"0 

-8/3" 

'-3 

1 " 

61/3 

-25/3 


1 

-14/3 

-5 

2 


P P 

D<~CC<~B 


4.8 SOLUTIONS 

Notes: This is an important section for engineering students and worth extra class time. To spend only one 
lecture on this section, you could cover through Example 5, but assign the somewhat lengthy Example 3 for 
reading. Finding a spanning set for the solution space of a difference equation uses the Basis Theorem 
(Section 4.5) and Theorem 17 in this section, and demonstrates the power of the theory of Chapter 4 in 
helping to solve applied problems. This section anticipates Section 5.7 on differential equations. The 
reduction of an n th order difference equation to a linear system of first order difference equations was 
introduced in Section 1.10, and is revisited in Sections 4.9 and 5.6. Example 3 is the background for Exercise 
26 in Section 6.5. 


1. Let y k = 2 k . Then 

Ta + 2 +2y k+l -*y k =2 k+ 2 + 2(2 A+1 )-8(2 A ) 

= 2 k ( 2 2 + 2 2 - 8 ) 

= 2 k (0) = 0 for all k 

Since the difference equation holds for all k, 2 k is a solution. 
Let y k = (-4) A . Then 

y k+2 + 2 y k+l - 8 y k = (-4)* +2 + 2(-4) A+1 - 8(-4) A ' 

= (-4) A ((-4) 2 + 2( 4) - 8) 

= (-4) a ( 0) = 0 for all k 

Since the difference equation holds for all k, (-4) A is a solution. 

2. Let y k =3 A . Then 

Ta- + 2-9jt= 3 A+2 -9(3 a ) 

= 3 a (3 2 -9) 

= 3 A (0) = 0 for all k 
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Since the difference equation holds for all k, 3 k is a solution. 

Let y k = (-3) A . Then 

y k+2 -9y k =(-3) k+2 -9(-3) k 
= (-3) A ((-3) 2 -9) 

= (— 3) a (0) =0 for all k 

Since the difference equation holds for all k, (-3) A is a solution. 

3. The signals 2 k and (-4) A are linearly independent because neither is a multiple of the other; that is, 
there is no scalar c such that 2 k = c(-4) A for all k. By Theorem 1 7, the solution set H of the difference 
equation y k+2 + 2 y k+l - 8 y k = 0 is two-dimensional. By the Basis Theorem, the two linearly independent 
signals 2 k and (-4) A form a basis for H. 

4. The signals 3 A and (-3) A are linearly independent because neither is a multiple of the other; that is, there 
is no scalar c such that 3 /l = c(-3) A for all k. By Theorem 17, the solution set H of the difference 
equation y k+2 - 9 y k = 0 is two-dimensional. By the Basis Theorem, the two linearly independent signals 
3 k and (-3) A form a basis for H. 

5. Let y k =(-3) A . Then 

yk+i + 6J7+, + 9 y k = (-3) a+2 + 6(-3) a+1 + 9(-3) A 
= (-3 ) a ((-3) 2 +6(-3) + 9) 

= (-3) A (0) = 0for all k 

Since the difference equation holds for all k, (-3) A is in the solution set H. 

Let y k = k(-3) k . Then 

yk+i + 6 y k+l + 9 y k =(k + 2)(-3) A+2 + 6 (k + 1)(-3) A+1 + 9k(-3) k 
= (-3) a ((* + 2)(-3) 2 + 6(k + 1)(-3) + 9k) 

= (-3) a (9 k + 1 8 - 1 8A: - 1 8 + 9A:) 

= (-3) A (0) = 0for all k 

Since the difference equation holds for all k, k{— 3) k is in the solution set H. 

The signals (-3) A and k(- 3) A are linearly independent because neither is a multiple of the other; 
that is, there is no scalar c such that (-3) k = ck(— 3) A for all k and there is no scalar c such that 
c(— 3) a = k ( 3 ) k for all k . By Theorem 1 7, dim H = 2, so the two linearly independent signals 3 /l 
and (-3 ) a form a basis for H by the Basis Theorem. 
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6. Let y k =5 A cos^. Then 


r k+~> (k + 2)n 

y k+2 + 2 5y k =5 k “cos- + 25 


= 5 


5 ? cos 


2 

(k + 2)n 


rk kn 
5 cos — 


kn A 
+ 25 cos — 
2 2 


f 

f kn ^ 

I kn' 

cos 


+ cos — 

V 

l 2 J 

1 2 ) 


= 25-5* 


= 25 • 5 A (0) = 0 for alU 


since cos(t + n) = -cos t for all t. Since the difference equation holds for all k, 5 cos is in the solution 
set H. 


Let y k = 5 k s\n^~. Then 

y k+ 2 +25 Ta- = 5 k+2 sin + 25 


= 5 


5 9 sin 


2 

(k + 2)n 


- k . kn 
5 sin — 


. kn A 
+ 25 sin — 
2 2 


f 

(kn ( 

I ■ kn' 

sin 

— +n 

+ sm — 

V 

l 2 J 

1 2 J 


= 25-5* 


= 25 • 5^(0) = 0 for all A: 


since sin(7 + n) = -sin t for all t. Since the difference equation holds for all k, 5 sin is in the solution 
set H. 

The signals 5 A cos^f and 5*' sin ^ are linearly independent because neither is a multiple of the other. By 
Theorem 17, dim H= 2, so the two linearly independent signals 5* cos^f and 5 A sin^f form a basis for 
H by the Basis Theorem. 


7. Compute and row reduce the Casorati matrix for the signals \ k , 2 k , and (—2) k , setting k = 0 for 
convenience: 


"l° 

2° 

(-2)°' 


“1 

0 

0 " 

l 1 

2 1 

(-2) 1 

~ 

0 

1 

0 

l 2 

2 2 

(-2) 2 _ 


0 

0 

1 


This Casorati matrix is row equivalent to the identity matrix, thus is invertible by the IMT. Hence the set 
of signals {1 A , 2 A , ( — 2)* } is linearly independent in . The exercise states that these signals are in the 
solution set H of a third-order difference equation. By Theorem 17, dim H= 3, so the three linearly 
independent signals 1 A , 2 k , (— 2) A form a basis for H by the Basis Theorem. 
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8. Compute and row reduce the Casorati matrix for the signals 2 k , 4*, and (—5)*, setting k = 0 for 
convenience: 


"2° 

4° 

(-5)°' 


“1 

0 

0 " 

2 1 

4 1 

(-5) 1 

~ 

0 

1 

0 

2 2 

4 2 

(~ 5 ) 2 _ 


0 

0 

1 


This Casorati matrix is row equivalent to the identity matrix, thus is invertible by the IMT. Hence the set 
of signals {2 k ,4* ,(-5)* } is linearly independent in . The exercise states that these signals are in the 
solution set H of a third-order difference equation. By Theorem 17, dim H= 3, so the three linearly 
independent signals 2 k , 4* , (-5)* form a basis for H by the Basis Theorem. 

9. Compute and row reduce the Casorati matrix for the signals \ k , 3* cos^f, and 3* sin-y, setting k = 0 for 
convenience: 


"l° 

3° cos 0 

3° sin 0 


“1 

0 

0 " 

l 1 

S'cos/f 

3'sinf 

~ 

0 

1 

0 

l 2 

3 2 cos n 

3 2 sin;r 


0 

0 

1 


This Casorati matrix is row equivalent to the identity matrix, thus is invertible by the IMT. Hence the set 
of signals {1 A ,3 A cos-y,3 A sin is linearly independent in . The exercise states that these signals are in 
the solution set //of a third-order difference equation. By Theorem 17, dim H= 3, so the three linearly 
independent signals \ k , 3* cosy , and 3 A siny, form a basis for H by the Basis Theorem. 

10 . Compute and row reduce the Casorati matrix for the signals (- 1 ) A , k(— \) k , and 5 k , setting k = 0 for 
convenience: 


~(-l)° 

0(-l)° 

5°' 


"1 

0 

0 " 

(-1) 1 

l(-l) 1 

5 1 

~ 

0 

1 

0 

_(-l) 2 

2(-l) 2 

5 2 


0 

0 

1 


This Casorati matrix is row equivalent to the identity matrix, thus is invertible by the IMT. Hence the set 
of signals {(-1)* , /c ( — 1 ) x , 5 k } is linearly independent in . The exercise states that these signals are in the 
solution set H of a third-order difference equation. By Theorem 17, dim H= 3, so the three linearly 
independent signals ( — 1) A , k(— 1) A , and 5 k form a basis for H by the Basis Theorem. 

11 . The solution set //of this third-order difference equation has dim H = 3 by Theorem 17. The two signals 
(-1)* and 3* cannot possibly span a three-dimensional space, and so cannot be a basis for H. 

12 . The solution set H of this fourth-order difference equation has dim H = 4 by Theorem 17. The two 
signals 1* and ( — 1 ) A cannot possibly span a four-dimensional space, and so cannot be a basis for H. 

13 . The auxiliary equation for this difference equation is r 2 — r + 2/9 = 0. By the quadratic formula 
(or factoring), r = 2/3 or r = 1/3, so two solutions of the difference equation are (2/3)* and (1/3)* . 

The signals (2/3)* and (1/3)* are linearly independent because neither is a multiple of the other. 
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By Theorem 17, the solution space is two-dimensional, so the two linearly independent signals (2/3) A 
and (1 / 3 ) a form a basis for the solution space by the Basis Theorem. 

14. The auxiliary equation for this difference equation is r 2 -7r + 12 = 0. By the quadratic formula (or 
factoring), r = 3 or r = 4, so two solutions of the difference equation are 3 A and 4 A . The signals 3 A and 
4 A are linearly independent because neither is a multiple of the other. By Theorem 1 7, the solution space 
is two-dimensional, so the two linearly independent signals 3 A and 4 A form a basis for the solution 
space by the Basis Theorem. 

15. The auxiliary equation for this difference equation is r 2 - 25 = 0. By the quadratic formula (or factoring), 
r = 5 or r = -5, so two solutions of the difference equation are 5 k and (-5) A . The signals 5 A and (-5) A 
are linearly independent because neither is a multiple of the other. By Theorem 17, the solution space is 
two-dimensional, so the two linearly independent signals 5 A and (-5) A form a basis for the solution 
space by the Basis Theorem. 

16. The auxiliary equation for this difference equation is 16r 2 + 8r — 3 = 0. By the quadratic formula (or 
factoring), r = 1/4 or r = -3/4, so two solutions of the difference equation are (1/4) A and ( — 3 / 4) A . The 
signals (1/4) A and ( — 3 / 4) A are linearly independent because neither is a multiple of the other. By 
Theorem 17, the solution space is two-dimensional, so the two linearly independent signals (1/4) A and 
( — 3 / 4 ) a form a basis for the solution space by the Basis Theorem. 

17. Letting a = .9 and b = 4/9 gives the difference equation Yh+2 1 .3 Y k+X + AY k =1. First we find a particular 

solution Y k =T of this equation, where Tis a constant. The solution of the equation T - 1.3T + AT = 1 is 
T = 1 0, so 1 0 is a particular solution to Y/c+2 1 3Y k+x + AY k = 1 . Next we solve the homogeneous 

difference equation Yk+2 1 .3 Y k+X +AY k = 0. The auxiliary equation for this difference equation is 

r 2 — 1.3r + .4 = 0. By the quadratic formula (or factoring), r = .8 or r = .5, so two solutions of the 
homogeneous difference equation are .8 A and .5 k . The signals (.8) A and (,5) A are linearly independent 
because neither is a multiple of the other. By Theorem 1 7, the solution space is two-dimensional, so the 
two linearly independent signals (.8) A and (,5) A form a basis for the solution space of the homogeneous 
difference equation by the Basis Theorem. Translating the solution space of the homogeneous difference 
equation by the particular solution 1 0 of the nonhomogeneous difference equation gives us the general 
solution of Yk+ 2 1 .3 Y k+X + AY k = 1 : Y k -c x (,8) A + c 2 (,5) A +10. As k increases the first two terms in the 
solution approach 0, so Y k approaches 10. 

18. Letting a = .9 and b = .5 gives the difference equation Y k+2 -\35Y k+x +A5Y k =1. First we find a 
particular solution Y k = T of this equation, where T is a constant. The solution of the equation 

T - 1.35T + A5T = 1 is T= 10, so 10 is a particular solution to Y k+1 -\3Y k+x + AY k = 1 . Next we solve the 
homogeneous difference equation ^t+2 1 .35 Y k+X + A5Y k = 0. The auxiliary equation for this difference 

equation is r 2 — 1.35r + .45 = 0. By the quadratic formula (or factoring), r = .6 or r = .75, so two 
solutions of the homogeneous difference equation are ,6 A and .75 A . The signals (.6) /l and (.75) A are 
linearly independent because neither is a multiple of the other. By Theorem 1 7, the solution space is two- 
dimensional, so the two linearly independent signals (.6) A and (.75) /l form a basis for the solution space 
of the homogeneous difference equation by the Basis Theorem. Translating the solution space of the 
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homogeneous difference equation by the particular solution 10 of the nonhomogeneous difference 
equation gives us the general solution of Y k+2 —1.35 Y k+l + .457, =1:7* = Cl (.6)* + c 2 (.75)* +10. 


19. The auxiliary equation for this difference equation is r' + 4r + 1 = 0. By the quadratic formula, 

r = -2 + s/3 or r = -2 - s/3, so two solutions of the difference equation are (-2 + s/3)* and (-2 - -s/3)*. 
The signals (-2 + s/3)* and (-2 - s/3)* are linearly independent because neither is a multiple of the 
other. By Theorem 1 7, the solution space is two-dimensional, so the two linearly independent signals 
(-2 + s/3)* and (-2 - s/3)* form a basis for the solution space by the Basis Theorem. Thus a general 
solution to this difference equation is y k = c, (-2 + s/3)* + c 2 (-2 - s/3 )* . 


20. Let a = -2 + s/3 and b = -2 - s/3 . Using the solution from the previous exercise, we find that 

Vj = qa + c 2 b = 5000 and >’ iV = qa A + c 2 b N = 0. This is a system of linear equations with variables 
q and c 2 whose augmented matrix may be row reduced: 

5000 b N 


a 

N 


b 

b N 


5000 

0 


1 0 


0 1 


b a-a b 
5000 / 
b a-a b. 


so 


5000# 


N 


c, =- 


1 « iV I 

b a-a b 


Nt ’^2 


C, =- 


5000a 

,Tv iv7 

b a-a b 


(Alternatively, Cramer’s Rule may be applied to get the same solution). Thus 

y k =c x a k +c 2 b k 

_ 5000 (a k b N -a N b k ) 
b N a — a N b 


21. The smoothed signal z k has the following values: z x = (9 + 5 + 7) / 3 = 7, z 2 = (5 + 7 + 3) / 3 = 5, 
z 3 =(7 + 3 + 2)/3 = 4, z 4 = (3 + 2 + 4) / 3 = 3, z 5 =(2 + 4 + 6)/3 = 4, z 6 = (4 + 6 + 5)/3 = 5, 
z 7 =(6 + 5 + 7)/3 = 6, z 8 = (5 + 7 + 6) / 3 = 6, z 9 = (7 + 6 + 8)/3 = 7, z 10 = (6 + 8 + 10)/3 = 8, 
z n = (8 + 1 0 + 9) / 3 = 9, z 12 =(10 + 9 + 5)73 = 8, z 13 = (9 + 5 + 7)/3 = 7. 


original data 



22. a. The smoothed signal z, has the following values: 

Zq = ,35y 2 + ,5 ti + ,35y 0 = .35(0) + ,5(.7) + .35(3) = 1 .4, 
zj = ,35y 3 + ,5y 2 + 35 y l = ,35(-.7) + .5(0) + .35(.7) = 0, 
z 2 = ,35y 4 + .5y 3 + ,35y 2 = ,35(-.3) + ,5(-.7) + .35(0) = -1.4, 
z 3 = ,35y 5 + .5 y 4 + ,35y 3 = .35(— .7) + .5(-.3) + ,35(-.7) = -2, 
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z 4 = .35 y 6 + .5 v 5 + .35 y 4 = .35(0) + .5(-.7) + .35(— .3) = -1.4, 
z 5 = .35 y 7 + .5 y 6 + .35 v 5 = ,35(.7) + .5(0) + ,35(-.7) = 0, 
z 6 = .35 v 8 + .5 y 1 + .35 y 6 = .35(3) + ,5(.7) + .35(0) = 1 .4, 
z 7 = .35 y 9 + .5 v 8 + .35 y 1 = ,35(.7) + .5(3) + ,35(.7) = 2, 
z 8 = .35 v 10 + .5 y 9 + .35 j 8 = .35(0) + ,5(.7) + .35(3) = 1.4,... 

b. This signal is two times the signal output by the filter when the input (in Example 3) was 

y = cos(7ft/4). This is expected because the filter is linear. The output from the input 2cos(7ff/4) + 
cos( 37^/4) should be two times the output from cos(7Z?/4) plus the output from cos(3^f/4) (which is 
zero). 

23. a. y k+1 -\.Q\y k =-450, y 0 =10,000. 

b. [M] MATLAB code to create the table: 

pay = 450, y= 10000, m=0, table = [0;y] 
while y>450 

y = 1 . 01*y-pay 
m = m+1 

table = [table [m;y] ] 

end 

m,y 

Mathematica code to create the table: 

pay = 450; y = 10000; m = 0; balancetable = {{0, y} } ; 

While [y > 450, {y = 1.01*y - pay; m = m+1, 

AppendTo [balancetable , {m, y } ] } ] ; 

m 
Y 

c. [M] At month 26, the last payment is $1 14.88. The total paid by the borrower is $1 1,364.88. 

24. a. y k+l — 1 .005 = 200, y 0 =1,000. 

b. [M] MATLAB code to create the table: 

pay = 200, y= 1000, m=0, table = [0;y] 
for m = 1 : 6 0 

y = 1 . 005*y+pay 
table = [table [m;y] ] 

end 

interest = y- 6 0*pay- 10 0 0 
Mathematica code to create the table: 

pay = 200; y = 1000; amounttable = {{0, y} } ; 

Do [ {y = 1.005*y + pay; 

AppendTo [amounttable , {m, y } ] } , {m, 1 , 6 0 } ] ; 

interest = y- 6 0*pay- 10 0 0 
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c. [M] The total is $6213.55 at k = 24, $12,090.06 at k = 48, and $15,302.86 at k = 60. When k = 60, the 
interest earned is $2302.86. 

25 . To show that y k =k 2 is a solution of y k+2 + 3 k+x - 4 y k = 1 0A' + 7, substitute y k = k 2 , y k+l =(k + 1) 2 , and 
Ti + 2 =(k + 2) 2 : 

W +2 + 3t+i - 4 y k =(k + 2 f + 3(k + 1) 2 - 4k 2 

— ( A 2 + 4A + 4) + 3(k~ + 2 A- + 1) — 4A~~ 

= k~ + 4Ar + 4 + 3A" + 6A' + 3 — 4A~~ 

= 1 0A" + 7 for all k 

The auxiliary equation for the homogeneous difference equation y k+2 + 3y k+x - 4 y k = 0 is r 2 + 3r - 4 = 0. 
By the quadratic formula (or factoring), r = -4 or r = 1, so two solutions of the difference equation are 
(-4/ and 1 A . The signals (—4/ and \ k are linearly independent because neither is a multiple of the other. 
By Theorem 17, the solution space is two-dimensional, so the two linearly independent signals (—4)* and 
1 A form a basis for the solution space of the homogeneous difference equation by the Basis Theorem. The 
general solution to the homogeneous difference equation is thus q (-4)* + c 2 ■ 1 k = q (-4) k + c 2 . Adding the 
particular solution k 2 of the nonhomogeneous difference equation, we find that the general solution of the 
difference equation y k+2 + 3y k+i - 4 y k =10k + 7 is y k = k 2 + q (~4) k + c 2 . 

26 . To show that y k = 1 + k is a solution of y k+1 - 8 y k+x + 1 5 y k = 8A' + 2, substitute y k = 1 + k , 
y k+] = 1 + {k + 1) = 2 + k, and y k+2 =1 + (A: + 2) = 3 + k : 

yk+2 ~ 1 + 1 5 y k = (3 + k) - 8(2 + k) + 1 5(1 + k) 

= 3 + A' - 1 6 - 8A' + 15 + 1 5A' 

= 8 A + 2 for all k 

The auxiliary equation for the homogeneous difference equation y k+2 - 8>y +1 + 1 5 y k = 0 is 
r 2 - 8r + 15 = 0. By the quadratic formula (or factoring), r = 5 or r = 3, so two solutions of the difference 
equation are 5 k and 3 k . The signals 5 k and 3 /l are linearly independent because neither is a multiple of 
the other. By Theorem 1 7, the solution space is two-dimensional, so the two linearly independent signals 
5 k and 3 2 form a basis for the solution space of the homogeneous difference equation by the Basis 
Theorem. The general solution to the homogeneous difference equation is thus q • 5 k + c 2 ■ 3 k . Adding 
the particular solution 1 + k of the nonhomogeneous difference equation, we find that the general solution 
of the difference equation y k+2 - 8 y k+l + 1 5 y k = 8k + 2 is y k = 1 + k + q • 5 k + c 2 ■ 3 /l . 

27 . To show that y k =2 -2k is a solution of y k+2 - (9/2 )y k+l + 2 y k = 3k + 2, substitute y k = 2- 2k, 
y k+1 =2- 2{k + 1) = -2k, and y k+2 = 2- 2(k + 2) = -2-2k: 

y k+2 -(9/2)y k+1 +2 y k = (-2 - 2k) - (9 / 2)(-2k) + 2(2 - 2k) 

= -2-2k + 9k + 4-4k 
= 3k + 2 for all k 

The auxiliary equation for the homogeneous difference equation y k+2 - (9 ! 2) y k+] + 2y k = 0 is 
r 2 - (9/ 2)r + 2 = 0. By the quadratic formula (or factoring), r = 4 or r = 1/2, so two solutions of the 
difference equation are 4 A and (1/2) A . The signals 4 A and (1/2) A are linearly independent because 
neither is a multiple of the other. By Theorem 17, the solution space is two-dimensional, so the two 
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linearly independent signals 4 A and (1 /2) k form a basis for the solution space of the homogeneous 
difference equation by the Basis Theorem. The general solution to the homogeneous difference 
equation is thus q • 4 k + c 2 ■ (1/2) A =c 1 -4 k +c 2 -2~ k . Adding the particular solution 2 - 2k of the 
nonhomogeneous difference equation, we find that the general solution of the difference equation 
y k+ 2 - (9 / 2)y k+ i + 2 y k = 2k + 2 is y k = 2 - 2k + q • 4 k + c 2 ■ 2~ k . 

28. To show that y k =2k-4 is a solution of y k+2 + (3 / 2 )y k+{ - y k = 1 + 3£, substitute y k = 2k-4 , 
y k+l = 2(k + 1) - 4 = 2k - 2, and y k+2 = 2{k + 2) - 4 = 2 k \ 
y k+2 + (3 / 2 )y k+1 -y k =2k + (3/ 2)(2 k - 2) - (2k - 4) 

= 2^ + 3/r - 3 - 2^r + 4 
= 1 + 3£ for all k 

The auxiliary equation for the homogeneous difference equation y k+2 + (3 / 2)jv Jt+1 -y k = 0 is 
r 2 + (3/2 )r -1 = 0. By the quadratic formula (or factoring), r = -2 or r = 1/2, so two solutions of the 
difference equation are (— 2) A and (1/ 2)*. The signals (-2/ and ( 1 / 2 ) A are linearly independent 
because neither is a multiple of the other. By Theorem 1 7, the solution space is two-dimensional, so the 
two linearly independent signals (—2) k and (1/2/' form a basis for the solution space of the 
homogeneous difference equation by the Basis Theorem. The general solution to the homogeneous 
difference equation is thus q • (—2) k + c 2 ■ (1/2)* = q • (-2)' + c 2 ■ 2~ k . Adding the particular solution 
2k - 4 of the nonhomogeneous difference equation, we find that the general solution of the difference 
equation y k+2 + (3 / 2)y k+l - y k = \ + 2k is y k = 2k - 4 + q • (-2) A + q, • 2~ k . 


y k ] U + il To 1 

. . y k +\ rj,i y k + 2 9 o 

29. Let x, = . Then x, , , = = 

y k+2 y k+ 3 0 0 

_y k+ 3 i [y^l L 9 ~ 6 


0 

1 

0 

-8 


o y k 

0 y k+ 1 

1 y k+ 2 

_y k + 3 _ 


= ^X*. 



0 Ti 

1 y k+ 1 = 
3/4jU + 2_ 


31. The difference equation is of order 2. Since the equation jy i+3 + 5 >y. +2 + 6i^ A . +1 = 0 holds for all k, 
it holds if k is replaced by k- 1. Performing this replacement transforms the equation into 

y k+ 2 + 5 y k+l + 6 ,1-7. = 0, which is also true for all k. The transformed equation has order 2. 

32. The order of the difference equation depends on the values of a l5 a 2 , and a 3 . If a 3 ^ 0, then the 
order is 3. If a 3 =0 and a 2 ^ 0, then the order is 2. If a 3 =a 2 = 0 and a, ^ 0, then the order is 1. 
If a 3 = a 2 = a x = 0, then the order is 0, and the equation has only the zero signal for a solution. 
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In particular, 


C(0) = 


0 

1 


,C(- 1) 


1 

0 


-2 

0 


, and C{— 2) = 


4 

1 



none of which are invertible. In fact, C(k) is not invertible for all k, since 

det C(k) = 2 k 2 (k + 1) | k + 1 1 -2{k + 1) 2 k \ k j = 2k(k + 1) ( k \ k + 1 1 - (k + 1) | k |) 

If k= 0 or k = -1, det C(k) = 0. If k> 0, then k + 1 > 0 and k\ k+ 1 | - {k+ 1)| k \ = k(k+ 1) - (k+ 1 )k= 0, 
so det C(k ) = 0. If k<-\, then k + 1 < 0 and k\ k+ 1 (k+ 1)| k \ = -k(k+ 1) + (k+ \ )k= 0, so 

det C(k) = 0. Thus dctC(/c)=0 for all k, and C{k) is not invertible for all k. Since C{k) is not invertible 
for all k, it provides no information about whether the signals {y k } and \z k } are linearly dependent 
or linearly independent. In fact, neither signal is a multiple of the other, so the signals {y k } and \z k } 
are linearly independent. 


34. No, the signals could be linearly dependent, since the vector space V of functions considered on the 
entire real line is not the vector space of signals. For example, consider the functions / ( t ) = si rut/, 
g(t ) = sin 2 71/, and h(t) = sin 37t/. The functions/ g, and h are linearly independent in V since they have 
different periods and thus no function could be a linear combination of the other two. However, sampling 
the functions at any integer n gives / («) = g{n) = h(n) = 0, so the signals are linearly dependent in . 


35. Let {y k } and {z k } be in , and let r be any scalar. The k th term of {y k } + {z k } is y k + z k , while the k th 
term of r{y k } is ry k . Thus 

T({y k } + {z k }) = T{y k + z k } 

=(y k+ 2 +z k + 2 ) +a (y k+ i +z k + i) +b (yk +z k) 

= (y k+ 2 + ay k+ 1 + by k ) + (z k+ 2 + az k+l + bz k ) 

= T{y k } + T{ z k ), and 
T(j{y k }) = T{ry k } 

= r y k+ 2 + a(ry k+l ) + b(ry k ) 

= r(y k+2 +ay k+l +by k ) 

= rT{y k } 

so T has the two properties that define a linear transformation. 


36. Let z be in V, and suppose that x /; in V satisfies T(x p ) = z. Let u be in the kernel of T\ then T(u) = 0. 
Since T is a linear transformation, T(u + \ p ) =T(u) + T(\ p ) = 0 + z = z, so the vector x = u + x /; satisfies 
the nonhomogeneous equation T(x) = z. 

37. We compute that 

(TD)(y 0 ,y l ,y2,...) = T(D(y 0 ,y l ,y2,...)) = T( 0 ,y 0 ,y l ,y 2 ,...) = (y 0 ,y l ,y2,...) 

while 

(DT)(y 0 ,y l ,y 2 ,...) = D(T(y 0 ,y l ,y 2 ,...)) = D(y 1 ,y 2 ,y 3 ,...) = (0,y l ,y 2 ,y 3 ,...) 

Thus TD = I (the identity transformation on 0 ), while DT A I. 
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4.9 SOLUTIONS 


Notes: This section builds on the population movement example in Section 1.10. The migration matrix is 
examined again in Section 5.2, where an eigenvector decomposition shows explicitly why the sequence of 
state vectors x k tends to a steady state vector. The discussion in Section 5.2 does not depend on prior 
knowledge of this section. 


1. a. Let N stand for “News” and M stand for “Music.” Then the listeners’ behavior is given by the table 


From: 



N 

M 

To: 

.7 

.6 

N 

.3 

.4 

M 


so the stochastic matrix is 



.6 

.4 ' 


b. Since 100% of the listeners are listening to news at 8: 15, the initial state vector is 

c. There are two breaks between 8: 15 and 9: 25, so we calculate x 2 : 

.1 

.3 

“.67' 

.33 

Thus 33% of the listeners are listening to news at 9: 25. 


Xi = Px 0 = 


X 2 = PXy = 


".7 

.6“ 

T 

.3 

.4 

0 

".7 

.6“ 

".7“ 

.3 

.4 

.3 



2. a. Let the foods be labelled “ 


so the stochastic matrix is 


P = 


'2,” and “3.” Then the animals’ behavior is given by the table 


1 

From: 

2 

3 

To: 

.5 

.25 

.25 

1 

.25 

.5 

.25 

2 

.25 

.25 

.5 

3 


.5 .25 .25 

.25 .5 .25 

.25 .25 .5 


b. There are two trials after the initial trial, so we calculate x 2 . The initial state vector is 


1 

0 

0 



“ .5 

.25 

.25“ 

T 


“ .5“ 

* 

li 

Tj 

o 

II 

.25 

.5 

.25 

0 

= 

.25 


.25 

.25 

.5 

0 


.25 


X 2 =PXj = 

“ .5 
.25 

.25 

.5 

.25“ 

.25 

“ .5“ 
.25 

— 

“ .375“ 
.3125 


.25 

.25 

.5 

.25 


.3125 


Thus the probability that the animal will choose food #2 is .3 125. 
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3. a. Let H stand for “Healthy” and / stand 


so the stochastic matrix is 



for “111.” Then the students’ conditions are given by the table 


From: 


H 

1 

To: 

.95 

.45 

H 

.05 

.55 

1 


45 

,55 


b. Since 20% of the students are ill on Monday, the initial state vector is x 0 = 


.2 


For Tuesday’s 


percentages, we calculate x, ; for Wednesday’s percentages, we calculate x 2 : 


Xi = Px 0 = 


X 2 = PXi = 


.95 

.45 

.8 

.05 

.55 

.2 

.95 

.45" 

'.85 

.05 

.55 

.15 


.85 

.15 



".875" 


.125 


Thus 15% of the students are ill on Tuesday, and 12.5% are ill on Wednesday. 

T 


c. Since the student is well today, the initial state vector is x 0 = 


0 


We calculate x 


2 • 


Xi = Px 0 


x 2 = Px 1 


95 

.45" 

"l" 


".95" 

05 

.55_ 

0 


.05 


95 

.45" 

".95" 


".925" 

05 

.55 

.05 


.075_ 


Thus the probability that the student is well two days from now is .925. 


4. a. Let G stand for good weather, / for indifferent weather, and B for bad weather. Then the change in the 
weather is given by the table 


so the stochastic matrix is 



G 

From: 

1 

B 

To: 

.6 

.4 

.4 

G 

.3 

.3 

.5 

1 

.1 

.3 

.1 

B 


.4 .4 

.3 .5 

.3 .1 


b. The initial state vector is 


Xl = Px 0 = 


. We calculate x, : 


".6 

.4 

.4" 

".5" 


".5" 

.3 

.3 

.5 

.5 

= 

.3 

.1 

.3 

.1 

0 


.2 


Thus the chance of bad weather tomorrow is 20%. 



4.9 • Solutions 


245 


c. The initial state vector is x n = 


x i = Px o = 


.6 A A 

.3 .3 .5 

.1 .3 .1 


We calculate 


.4 

.42 

.18 



".6 

.4 

.4' 

" .4 ' 


'.48' 

II 

II 

* 

.3 

.3 

.5 

.42 

= 

.336 


.1 

.3 

.1 

.18 


.184 


Thus the chance of good weather on Wednesday is 48%. 

5. We solve Px = x by rewriting the equation as (P - I)x = 0, where P — 1 = 
augmented matrix for the homogeneous system (P - I)x = 0 gives 


-.9 .6 

.9 -.6 


Row reducing the 


'-.9 

.6 

0" 


"1 

-2/3 

0" 

.9 

-.6 

0 


0 

0 

0 


Xj 

= x 2 

"2/3" 

, and one solution is 

"2" 

. Since the entries in 

"2" 

x 2 


1 


3_ 


3 


Thus x — 


obtain the steady- state vector q = 


sum to 5, multiply by 1/5 to 


'2/5' 


".4" 

3/5 


.6 


6. We solve Px = x by rewriting the equation as (P - I)x = 0, where P — 1 = 
augmented matrix for the homogeneous system (P - I)x = 0 gives 


-.2 .5 

.2 -.5 


. Row reducing the 


'-.2 

.5 

O' 


"1 

-5/2 

0" 

.2 

-.5 

0 


0 

0 

0 


Xj 

= x 2 

"5/2" 

, and one solution is 

'5" 

. Since the entries in 

"5" 

_x 2 _ 


1 


2 


2 


Thus x = 
obtain the steady- state vector q = 


sum to 7, multiply by 1/7 to 


5/7 

2/7 


.714 

.286 


7. We solve Px = x by rewriting the equation as (P - I)x = 0, where P — 1 = 


-.3 

.2 

.1 


.1 

-.2 

.1 


Row 


reducing the augmented matrix for the homogeneous system (P - I)x = 0 gives 


'-.3 

.1 

.1 

0 " 


"1 

0 

-1 

0 " 

.2 

-.2 

.2 

0 

~ 

0 

1 

-2 

0 

.1 

.1 

-.3 

0 


0 

0 

0 

0 
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Thus x= x 2 =x 3 2 , and one solution is 2 . Since the entries in 2 sum to 4, multiply by 1/4 to 

x 3 j [lj [iJ L 1 

"1/4] [.25" 

obtain the steady- state vector q = 1/2 = .5 . 

1/4J |_.25 

“-.3 .2 2 

8. We solve Px = x by rewriting the equation as (P - I)x = 0, where P-I = 0 -.8 .4 . Row 

.3 .6 -.6 

reducing the augmented matrix for the homogeneous system (P - I)x = 0 gives 


"-.3 

.2 

.2 

0 " 


"1 

0 

-1 

0 " 

0 

-.8 

.4 

0 

~ 

0 

1 

-1/2 

0 

.3 

.6 

-.6 

0 


0 

0 

0 

0 


Thus x = x 2 =x 3 1/2 , and one solution is 1 . Since the entries in 1 sum to 5, multiply by 1/5 to 
x 3 1 2 2 

"2/5] |".4" 

obtain the steady- state vector q = 1/5 = .2 . 

2/5 .4 


2 .84 .2 

9 . Since P = ^ ^ has all positive entries, P is a regular stochastic matrix. 


10 . Since P k = 


1 1-i 
0 . 8 *' 


will have a zero as its (2,1) entry for all k, so P is not a regular 


stochastic matrix. 


11 . From Exercise 1 , P = 


".7 

.6" 

, so P-I = 

"-.3 

.6" 

.3 

.4 


_ - 2 3 

-.6 


Solving (P - I)x ~ 0 by row reducing the 


augmented matrix gives 

"-.3 .6 Ol I" 1 -2 0" 

.3 -.6 0J ~ [o 0 0 

x, 2 [21 [21 

Thus \ = =x 2 , and one solution is . Since the entries in sum to 3, multiply by 1/3 to 

Xt 1 1 1 


obtain the steady- state vector q = 


2/3] [.667 
1/3 ~ .333 
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.25 

.25“ 

“-.5 

.25 

.25' 

.5 

.25 

, so P — I = .25 

-.5 

.25 

.25 

.5 

.25 

.25 

-.5 


reducing the augmented matrix gives 


"-.5 

.25 

.25 

0“ 


.25 

-.5 

.25 

0 

- 

.25 

.25 

-.5 

0 



Thus x = x 2 = x 3 1 , and one solution is 1 . Since the entries in 1 sum to 3, multiply by 1/3 to 

x 3 j [lj |_iJ L 1 

“l/3l f.333" 

obtain the steady-state vector q = 1/3 ~ .333 . Thus in the long run each food will be preferred 

1 / 3 J [.333 

equally. 

[.95 .451 [-.05 .451 

13. a. From Exercise 3, P= , so P-I= . Solving (P -I )x = 0 by row reducing 

.05 ,55j [ - 05 -- 45 _ 

the augmented matrix gives 

“-.05 .45 Ol [ 1 -9 0“ 

.05 -.45 0j~[0 0 0 

M [9l [91 [91 

Thus x= =x 2 , and one solution is . Since the entries in sum to 10, multiply by 1/10 


Solving (P - 1)\ = 0 by row reducing 


to obtain the steady-state vector q = 


9/10l_r.9 
1/10 ~~ .1 


b. After many days, a specific student is ill with probability .1, and it does not matter whether that 
student is ill today or not. 



“.6 

.4 

.4] 

“-.4 

.4 

.4“ 

14. From Exercise 4, P = 

.3 

.3 

.5 , so P-1 = 

.3 

-.7 

.5 


.1 

.3 

.ij 

.1 

.3 

-.9 


the augmented matrix gives 


“-.4 

.4 

.4 

0“ 


“1 

0 

-3 

0“ 

.3 

-.7 

.5 

0 

~ 

0 

1 

-2 

0 

.1 

.3 

-.9 

0 


0 

0 

0 

0 


Thus x = x 2 = x 3 2 , and one solution is 2 . Since the entries in 2 sum to 6, multiply by 1/6 to 


obtain the steady-state vector q = 1/3 ~ .333 . Thus in the long run the chance that a day has good 

1/6 .167 


weather is 50%. 
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15. [M] Let P = 


.9821 .0029 

.0179 .9971 

augmented matrix gives 


, so P-I = 


-.0179 .0029 

.0179 -.0029 


. Solving (P - 1)\ = 0 by row reducing the 


'-.0179 

.0029 

0" 


"1 

-.162011 

0" 

.0179 

-.0029 

0 


0 

0 

0 


Xj 

= x 2 

.162011“ 

, and one solution is 

.16201 1“ 

. Since the entries in 

'.162011' 

_*2_ 


1 


1 


1 


Thus x = 

1.16201 1, multiply by 1/1.16201 1 to obtain the steady-state vector q = 
the total U.S. population would eventually live in California. 


.139423 

.860577 


sum to 


. Thus about 13.9% of 



".90 

.01 

.09" 


'-.10 

.01 

.09" 

16. [M] Let P = 

.01 

.90 

.01 

, so P-I = 

.01 

-.10 

.01 


.09 

.09 

.90 


.09 

.09 

-.1 


. Solving (P - /)x = 0 by row reducing the 


augmented matrix gives 


"-.10 

.01 

.09 

O' 


"1 

0 

-.919192 

0" 



.01 

-.10 

.01 

0 

- 

0 

1 

-.191919 

0 



.09 

.09 

-.1 

0 


0 

0 

0 

0 




Xj 


.919192“ 





.919192“ 


.919192“ 

x = 

x 2 

= x 3 

.191919 

, and one solution is 

.191919 

. Since the entries in 

.191919 


- X 3. 


1 

J 






1 


1 


2. 1 1 1 1 1 1, multiply by 1/2. 1 1 1 1 1 1 to obtain the steady-state vector q = 


.435407 
.090909 
.473684 

about (.090909)(2000) = 182 cars will be rented or available from the downtown location 


sum to 


Thus on a typical day, 


17. a. The entries in each column of P sum to 1 . Each column in the matrix P-I has the same entries as in 
P except one of the entries is decreased by 1 . Thus the entries in each column of P-I sum to 0, and 
adding all of the other rows of P - 1 to its bottom row produces a row of zeros. 

b. By part a., the bottom row of P - 1 is the negative of the sum of the other rows, so the rows of P-I 
are linearly dependent. 

c. By part b. and the Spanning Set Theorem, the bottom row of P-I can be removed and the remaining 
(/7 - 1) rows will still span the row space of P-I. Thus the dimension of the row space of P - / is less 
than 77. Alternatively, let A be the matrix obtained from P-I by adding to the bottom row all the other 
rows. These row operations did not change the row space, so the row space of P - 1 is spanned by the 
nonzero rows of A. By part a., the bottom row of A is a zero row, so the row space of P -I is spanned 
by the first (77 - 1) rows of A. 

d. By part c., the ra nk of P - /is less than n, so the Rank Theorem may be used to show that 
dimNulfP - 1) = 77 - rank(/ J - 1) > 0. Alternatively the Invertible Martix Theorem may be used 
since P-I is a square matrix. 
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18. If a= f}= 0 then P = 


1 0 
0 1 


. Notice that Px = x for any vector x m F 2 , and that 


and 


are two 


linearly independent steady-state vectors in this case. 
If a 0 or p^ 0, we solve (P-l)x = 0 where P-1 = 
matrix gives 


-a p 
a ~p 


. Row reducing the augmented 


1 

1 

'fca 

0" 


a 

~P 

0" 

1 

1 

0 


0 

0 

0 


So ax j = fix 2 , and one possible solution is to let x x = /?, x 2 = a. Thus x = 


*1 


~p 

- X 2- 


a 


in 


sum to a+ /?, multiply by \/(a+ fj) to obtain the steady-state vector q = 


. Since the entries 

1 \P 

a+ p a 


19. a. The product Sx equals the sum of the entries in x. Thus x is a probability vector if and only if its 
entries are nonnegative and Sx = 1 . 

b. Let P = [pj p 2 ... p„], where p t , p 2 , ..., p„ are probability vectors. By part a., 

SP = [S Pl Sp 2 ... Sp„] = [l 1 ... 1] = S 

c. By part b., S(Px) = (SP)x = Sx = 1 . The entries in Px are nonnegative since P and x have only 
nonnegative entries. By part a., the condition S(Px) = 1 shows that Px is a probability vector. 


20. LetP = [p[ p 2 ... p„], so P 2 =PP = [Rp! P Pl ... Rp,,]. By Exercise 19c., the columns of 

P 2 are probability vectors, so P 2 is a stochastic matrix. 

Alternatively, SP = S by Exercise 19b., since P is a stochastic matrix. Right multiplication by P gives 
SP 2 - SP, so SP = S implies that SP 2 = S. Since the entries in P are nonnegative, so are the entries in 
P 2 , and P 2 is stochastic matrix. 


21. [M] 

a. To four decimal places, 


.2779 

.2780 

.2803 

.2941 


.2817 

.2817 

.2817 

.2814 

.3368 

.3355 

.3357 

.3335 

,P 3 = 

.3356 

.3356 

.3355 

.3352 

.1847 

.1861 

.1833 

.1697 

.1817 

.1817 

.1819 

.1825 

.2005 

.2004 

.2007 

.2027 


.2010 

.2010 

.2010 

.2009 



.2816 

.2816 

.2816 

.2816 

.3355 

.3355 

.3355 

.3355 

.1819 

.1819 

.1819 

.1819 

.2009 

.2009 

.2009 

.2009 


The columns of P k are converging to a common vector as k increases. The steady state vector q 
".2816" 


for P is q = 


.3355 

.1819 

.2009 


which is the vector to which the columns of P k are converging. 
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b. To four decimal places, 



".8222 

.4044 

.5385" 


".7674 

.6000 

.6690" 

Q l0 = 

.0324 

.3966 

.1666 

,q 20 = 

.0637 

.2036 

.1326 


.1453 

.1990 

.2949 


.1688 

.1964 

.1984 


".7477 

.6815 

.7105' 


".7401 

.7140 

.7257" 

Q i0 = 

.0783 

.1329 

.1074 

,q 40 = 

.0843 

.1057 

.0960 


.1740 

.1856 

.1821 


.1756 

.1802 

.1783 


'.7372 

.7269 

.7315' 


".7360 

.7320 

.7338" 

Q so = 

.0867 

.0951 

.0913 

,q 60 = 

.0876 

.0909 

.0894 


.1761 

.1780 

.1772 


.1763 

.1771 

.1767 


'.7356 

.7340 

.7347" 


".7354 

.7348 

.7351" 

Q 10 = 

.0880 

.0893 

.0887 

,0 8O = 

.0881 

.0887 

.0884 


.1764 

.1767 

.1766 


.1764 

.1766 

.1765 



'.7353 

.7353 

.7353" 




Q U6 = 

Q ni = 

.0882 

.0882 

.0882 






.1765 

.1765 

.1765 





The steady state vector q for Q is 


q = 


.7353 

.0882 

.1765 


Conjecture: the columns of P k , where P is a regular 


stochastic matrix, converge to the steady state vector for P as k increases, 
c. Let P be an n x n regular stochastic matrix, q the steady state vector of P, and e . the j th column of 
the n x 77 identity matrix. Consider the Markov chain {\ k } where x k+] = Px k and x 0 = e=. By 
Theorem 18, x k = P k x 0 converges to q as k — > °° But P k x 0 = P k ej , which is the y th column of P k . 
Thus the j th column of P k converges to q as k — > °°; that is, P k -A [q q ... q] . 


22. [M] Answers will vary. 

MATLAB Student Version 4.0 code for Method ( 1): 

A=randstoc (32 ) ; flops (0); 
tic, x=nulbasis (A-eye (32 ) ) ; 
q=x/sum(x); toe, flops 

MATLAB Student Version 4.0 code for Method (2): 

A=randstoc (32 ) ; flops (0); 

tic, B=aM 00; q=B ( : ,1); toe, flops 
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Chapter 4 SUPPLEMENTARY EXERCISES 


1. a. 

b. 


c. 

d. 

e. 

f. 

g- 

h. 


j 

k 

1 

m 

n. 

o. 

P 


q 


True. This set is Span{v l5 . . . v } , and every subspace is itself a vector space. 


True. Any linear combination of v t , ..., is also a linear combination of v, , ..., v /; _| , v 
using the zero weight on v . 

False. Counterexample: Take \ p = 2v, . Then {v l5 . . . \ p } is linearly dependent. 

False. Counterexample: Let {e l5 e 2 , e 3 } be the standard basis for 3 . Then {e ls e 2 } is a linearly 
independent set but is not a basis for R 3 . 

True. See the Spanning Set Theorem (Section 4.3). 

True. By the Basis Theorem, S is a basis for V because S spans V and has exactly p elements. So S 
must be linearly independent. 

False. The plane must pass through the origin to be a subspace. 


False. Counterexample: 


2 

0 

0 


5 -2 

0 7 

0 0 


0 

3 

0 


True. This statement appears before Theorem 13 in Section 4.6. 
False. Row operations on A do not change the solutions of Ax = 0. 


False. Counterexample: A = 


1 

3 


2 

6 


A has two nonzero rows but the rank of A is 1 . 


False. If (/has k nonzero rows, then rank A = k and dimNul A = n - k by the Ra nk Theorem. 

True. Row equivalent matrices have the same number of pivot columns. 

False. The nonzero rows of A span Row A but they may not be linearly independent. 

True. The nonzero rows of the reduced echelon form E form a basis for the row space of each 
matrix that is row equivalent to E. 

True. If H is the zero subspace, let A be the 3x3 zero matrix. If dim H= 1 , let {v} be a basis for H 
andsetA = [v v v] . If dim H = 2, let {u,v} be a basis for H and set A = [u v v],for 
example. If dim H= 3, then H = 3 , so A can be any 3x3 invertible matrix. Or, let {u, v, w} be a 
basis for /f and set A = [u v w] . 


False. Counterexample: A = 


1 

0 


0 

1 


0 

0 


. If ra nk A = n (the number of columns in A), then the 


transformation x I— > Ax is one-to-one. 


r. True. If x i-» Ax is onto, then Col A = and ra nk A = m. See Theorem 12(a) in Section 1.9. 

s. True. See the second paragraph after Theorem 15 in Section 4.7. 

t. False. The / th column of P is Tb.-l . 

J C<—B L VJc 
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Note that S is a linearly dependent set, but each pair 


of vectors in S forms a linearly independent set. Thus any two of the three vectors 


f 


'-2' 


5" 

2 


5 


-8 

-1 

9 

-4 

9 

7 

3 


1 


1 


will be a basis for SpanS. 

3. The vector b will be in W = Span{ii[, u 2 } if and only if there exist constants c, and c 2 with 
CjU, + c 2 u 2 = b. Row reducing the augmented matrix gives 


'-2 

1 

k 


'-2 

1 

h 

4 

2 

b 2 

~ 

0 

4 

2 b x + b 2 

-6 

-5 

b 3 _ 


0 

0 

b { + 2 b 2 + b 3 


so W = Span{u l5 u 2 } is the set of all (b t , b 2 , b 3 ) satisfying b x + 2 b 2 + b 3 = 0. 


4. The vector g is not a scalar multiple of the vector f, and f is not a scalar multiple of g, so the set {f, g} is 
linearly independent. Even though the number g (t) is a scalar multiple of f(t) for each t, the scalar 
depends on t. 

5. The vector p, is not zero, and p 2 is not a multiple of p^ However, p 3 is 2p, +2p 2 , so p 3 is discarded. 
The vector p 4 cannot be a linear combination of p, and p 2 since p 4 involves t 2 but p, and p 2 do not 
involve t 2 . The vector p 5 is (3/2)p 1 - (l/2)p ? +p 4 (which may not be so easy to see at first.) Thus p 5 
is a linear combination of p l5 p 2 , and p 4 , so p 5 is discarded. So the resulting basis is {p ls p 2 ,p 4 }. 


6. Find two polynomials from the set {p l5 . . . ,p 4 } that are not multiples of one another. This is easy, 
because one compares only two polynomials at a time. Since these two polynomials form a linearly 
independent set in a two-dimensional space, they form a basis for H by the Basis Theorem. 

7. You would have to know that the solution set of the homogeneous system is spanned by two solutions. In 
this case, the null space of the 18x20 coefficient matrix A is at most two-dimensional. By the Ra nk 
Theorem, dimCol A = 20- dimNul A > 20-2= 18. Since Col A is a subspace of 18 , Col A = I 18 . Thus 
Ax = b has a solution for every b in I 18 . 

8. If n = 0, then H and V are both the zero subspace, and H=V.\in>0, then a basis for H consists of n 
linearly independent vectors u l5 .. . ,u„. These vectors are also linearly independent as elements of V. 

But since d imV = n, any set of n linearly independent vectors in V must be a basis for V by the Basis 
Theorem. So u l5 . . . ,u„ span V, and H = Span{u l5 . . . ,u„} = V. 

9. Let T: JR" » be a linear transformation, and let A be the m x n standard matrix of T. 

a. If T is one-to-one, then the columns of A are linearly independent by Theoerm 12 in Section 1.9, 
so dimNul A = 0. By the Ra nk Theorem, dimCol A = n - 0 = n, which is the number of columns of A. 
As noted in Section 4.2, the range of T is Col A, so the dimension of the range of T is n. 
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b. If T maps " onto R'", then the columns of A span m by Theoerm 12 in Section 1.9, so dimCol A = 
m. By the Ra nk Theorem, dimNul A = n- m. As noted in Section 4.2, the kernel of T is Nul A, so the 
dimension of the kernel of Tis n - m. Note that n - m must be nonnegative in this case: since A must 
have a pivot in each row, n > m. 

10. Let 5 = {v l5 ... , v }. If S were linearly independent and not a basis for V, then S would not span V. In 
this case, there would be a vector v /)+l in V that is not in Span{v l5 . . . , v }. Let S' = {v l5 . . . , v , v +1 }. 

Then S' is linearly independent since none of the vectors in S' is a linear combination of vectors that 
precede it. Since S' has more elements than S, this would contradict the maximality of S. Hence S must 
be a basis for V. 

11. If S is a finite spanning set for V, then a subset of S is a basis for V. Denote this subset of S by S'. Since 
S' is a basis for V, S' must span V. Since S is a minimal spanning set, S' cannot be a proper subset of S. 
Thus S' = S, and S is a basis for V. 

12. a. Let y be in Col AB. Then y = ABx for some x. But ABx = A(Bx ), so y = A(Bx ), and y is in Col A. 

Thus Col AB is a subspace of Col A, so ra nk AB = dimCol AB < dimCol A = ra nk A by Theorem 1 1 
in Section 4.5. 

b. By the Ra nk Theorem and part a.: 

rank AB = rank (AB) 1 = rank B T A T < rank B l = rank B 

13. By Exercise 12, ra nk PA < ra nk A, and ra nk A = rank(/ J 1 P)A = ra nk P 1 {PA) < ra nk PA , so 
ra nk PA = ra nk A. 

14. Note that (AQ) =Q A . Since Q is invertible, we can use Exercise 13 to conclude that 

rank (AQ) r = rank Q r A 1 = ra nk A 1 . Since the ra nks of a matrix and its transpose are equal (by the Ra nk 
Theorem), ra nk AQ = ra nk A. 

15. The equation Hi? = O shows that each column of B is in Nul A. Since NulH is a subspace off ", all linear 
combinations of the columns of B are in Nul A. That is, Col B is a subspace of Nul A. By Theorem 1 1 in 
Section 4.5, ra nk B = dimCol B < dimNul A. By this inequality and the Ra nk Theorem applied to A, 

n = ra nk A + dimNul A > ra nk A + ra nk B 

16. Suppose that ra nk A = q and rank B = r 2 . Then there are ra nk factorizations A = C, /?, and B = C 2 R 2 of 

A and B, where C, is m x r\ with ra nk r x , C 2 is m x r 2 with ra nk r 2 , R { is t\ X n with ra nk r x , and R 2 is 
r 2 xn with rank r 2 . Create an mx(r l +r 2 ) matrix C = [C, C 2 ] and an (r l +r 2 )xn matrix R by 

stacking R x over R^ Then 

A + B = C X R { + C 2 R 2 = C 2 \ 

_2 

Since the matrix CR is a product, its rank cannot exceed the rank of either of its factors by Exercise 12. 
Since C has /; + r 2 columns, the rank of C cannot exceed /; + r 2 . Likewise R has r x + r 2 rows, so the 
ra nk of R cannot exceed r x + r 2 . Thus the ra nk of A + B cannot exceed r x + r 2 = ra nk A + ra nk B, or 
rank (A + B) < rank A + rank B. 
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17. Let A be an m x n matrix with rank r. 

(a) Let Ay consist of the r pivot columns of A. The columns of A ] are linearly independent, so A x is an 
m x r matrix with rank r. 

(b) By the Ra nk Theorem applied to A,, the dimension of RowT, is r, so A { has r linearly independent 
rows. Let A 2 consist of the r linearly independent rows of A v Then A 2 is an r x r matrix with 
linearly independent rows. By the Invertible Matrix Theorem, A 2 is invertible. 

18. Let A be a 4 x 4 matrix and B be a 4 x 2 matrix, and let u 0 , . . . ,u 3 be a sequence of input vectors in 2 . 

a. Use the equation x t+1 = Ax k + Bu k for k = 0, . . . , 4, k = 0, ... ,4, with x 0 = 0. 

Xj = Ax 0 + 5u 0 = 5u 0 

x 2 = Ax j + = AB u 0 + Bu x 

x 3 = Ax 2 + Bu 2 = A(ABu 0 + i?Uj ) + Bu 2 = A 2 Bu 0 + ABu x + Bu 2 
x 4 = Ax 3 + Bu 3 = A(A 2 Bu 0 + ABu x + Bu 2 ) + 5u 3 
= A'Bu 0 + A 2 Bu x + ABu 2 + Bu 3 

U 3 

= \b AB A 2 B A 2 b\ ° 2 =M u 

L J U, 

u 0_ 

Note that M has 4 rows because B does, and that M has 8 columns because B and each of the matrices 
A k B have 2 columns. The vector u in the final equation is in 8 , because each u A . is in F 2 . 

b. If (A, B) is controllable, then the controlability matrix has rank 4, with a pivot in each row, and the 
columns of M span 4 . Therefore, for any vector v in f 4 , there is a vector u in 8 such that v = Mu. 
However, from part a. we know that x 4 = Mu when u is partitioned into a control sequence 

u 0 ,. . ,,u 3 . This particular control sequence makes x 4 = v. 

19. To determine if the matrix pair (A, B) is controllable, we compute the rank of the matrix 

| B AB To find the rank, we row reduce: 

"o i oi r i o o" 

[5 AB A 2 B^= 1 -.9 .81-0 1 0 . 

|_1 .5 .25J [o 0 1 

The ra nk of the matrix is 3, and the pair (A, B) is controllable. 

20. To determine if the matrix pair (A, B) is controllable, we compute the ra nk of the matrix 
| B AB A 2 To find the rank, we note that : 

“1 .5 .19" 

[5 AB A 2 B^= 1 .7 .45 . 

[0 0 0 

The ra nk of the matrix must be less than 3, and the pair (A, B) is not controllable. 
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21. [M] To determine if the matrix pair (A, B) is controllable, we compute the ra nk of the matrix 
B AB A 2 B A 2 B~^. To find the rank, we row reduce: 


B AB A Z B 




0 -1 1.6 -.96 

-1 1.6 -.96 -.024 


10 0 -1 
0 1 0 - 1.6 

0 0 1 - 1.6 

0 0 0 0 


The rank of the matrix is 3, and the pair (A, B) is not controllable. 


22. [M] To determine if the matrix pair (A, B ) is controllable, we compute the ra nk of the matrix 
| B AB A 2 B A 2 B~\^. To find the rank, we row reduce: 

io o -l] n o o o 

0 0 -1 .5 0 1 0 0 

0 -1 .5 11.45 0 0 1 0 

-1 .5 11.45 -10.275 J [0001 

The rank of the matrix is 4, and the pair (A, B) is controllable. 
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Eigenvalues and 
Eigenvectors 


5.1 SOLUTIONS 

Notes: Exercises 1-6 reinforce the definitions of eigenvalues and eigenvectors. The subsection on 
eigenvectors and difference equations, along with Exercises 33 and 34, refers to the chapter introductory 
example and anticipates discussions of dynamical systems in Sections 5.2 and 5.6. 


“3 

2' 


"2 

0' 


"l 

2' 

_3 

8_ 


0 

2 


_3 

6 


1. The number 2 is an eigenvalue of A if and only if the equation Ax = 2x has a nontrivial solution. This 
equation is equivalent to (A - 2 1)x = 0. Compute 


A-2I = 


The columns of A are obviously linearly dependent, so (A - 2I)x = 0 has a nontrivial solution, and so 
2 is an eigenvalue of A. 

2. The number -2 is an eigenvalue of A if and only if the equation Ax = -2x has a nontrivial solution. This 
equation is equivalent to (A + 2/)x = 0. Compute 


A + 2I = 


The columns of A are obviously linearly dependent, so (A + 2 1)x = 0 has a nontrivial solution, and so 
-2 is an eigenvalue of A. 


'7 3" 


'2 0‘ 


"9 3' 


+ 


= 


3 -1 


_° 2 _ 


3 1 


3. Is dx a multiple of x? Compute 


4. Is Ax a multiple of x? Compute 


3 f 

T 


f 

^ A 

T 

. So 

T 

3 8 

4 


29 


4 


4 


2 f 

— 1 + n/2 


-1 + 2V2 

1 4 

1 


3 + V2 


is not an eigenvector of^4. 


The second entries of x and Ax shows 


that if Ax is a multiple of x, then that multiple must be 3 + 42. Check 3 + 42 times the first entry of x: 
(3 + V2)(- 1 + 42) = -3 + ( 42 ] 2 + 242 = -1 + 2^2 


This matches the first entry of Ax, so 
eigenvalue is 3 + 42. 


— 1 + 42 


is an eigenvector of A, and the corresponding 
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3 7 

5. Is Ax a multiple of x? Compute -4 -5 

2 4 

eigenvalue 0. 



is an eigenvector of A for the 


3 6 7 1 -2 1 1 

6. Is Ax a multiple of x? Compute 3 3 7 -2 = 4 = (-2) -2 So -2 is an eigenvector of 

5 6 5_|[ lj |_ — 2 J |_ lj |_ 1 

A for the eigenvalue -2. 


7. To determine if 4 is an eigenvalue of A, decide if the matrix A — 41 is invertible. 

' 3 0 -ll [4 0 0] [-1 0 -1 

A-4I= 23 1-040=2 -1 1 

-3 4 5 J [o 0 4j |_-3 4 1 

Invertibility can be checked in several ways, but since an eigenvector is needed in the event that one 
exists, the best strategy is to row reduce the augmented matrix for (A - 4/)x = 0 : 

-1 0 -1 0 ] [-1 0 -1 0 ] f 1 0 10 

2-1 10 - 0 - 1 - 10 - 0 - 1-10 

-3 4 1 0J [ 0 4 4 Oj |_0 0 0 0 

The equation (A - 4 1)x = 0 has a nontrivial solution, so 4 is an eigenvalue. Any nonzero solution of 

(A -4/)x = 0 is a corresponding eigenvector. The entries in a solution satisfy x, + x 3 = 0 and 
-x 2 - x 3 = 0, with x 3 free. The general solution is not requested, so to save time, simply take any 
nonzero value for x 3 to produce an eigenvector. If x 3 = 1 , then x = (- 1 , - 1 , 1 ). 


Note: The answer in the text is (1, 1,-1), written in this form to make the students wonder whether the more 
common answer given above is also correct. This may initiate a class discussion of what answers are 
“correct.” 


8. To determine if 3 is an eigenvalue of A, decide if the matrix A- 31 is invertible. 

“1 2 2] [3 0 0] [-2 2 2 

A-3I = 3 -2 1- 030= 3 -5 1 

0 1 lj |_0 0 3j [ 0 1-2 

Row reducing the augmented matrix [(A -37) 0] yields: 

-2 2 2 0] [ 1 -1 -1 0] [ 1 0 -3 0 

3-5 10-0 1-20-01-20 

0 1 -2 0J [o -2 4 oj |_0 0 0 0 

The equation (A-3I)x = 0 has a nontrivial solution, so 3 is an eigenvalue. Any nonzero solution 
of (A - 3/)x = 0 is a corresponding eigenvector. The entries in a solution satisfy x, - 3x 3 = 0 and 
x 2 - 2.v, = 0, with x 3 free. The general solution is not requested, so to save time, simply take any 
nonzero value for x 3 to produce an eigenvector. If x 3 = 1, then x = (3, 2, 1). 
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9 . For /L = l: A-II = 


5 0 1 0 _ 4 0 

2 1 0 1 ~ 2 0 


4 0 0 

The augmented matrix for (A-I)x = 0 is ^ ^ . Thus x, =0 and x 2 is free. The general solution 


of (A-I)x - 0 is x 2 e 2 , where e 2 = , and so e 2 is a basis for the eigenspace corresponding to the 


eigenvalue 1. 

For A = 5: A- 51 = 


5 0 5 0 _ 0 0 

2 1 0 5 ~ 2 -4 


The equation ( A - 5/)x = 0 leads to 2x, - 4x 2 = 0, so that x l = 2x 2 and x 2 is free. The general solution 

. lx,! r2x,l f2l f 2 l . .... . 



Xj 


2x 2 


" 2 " 


is 


= 


= x 2 

1 

. So 


x 2 


x 2 




10 . ForT = 4: A-4I = 


10 -9 4 0 _ 6 -9 

4 -2 0 4 ~ 4 -6 


The augmented matrix for ( A - 4/)x = 0 is 


6-9 0 1 -9/6 0 

4 -6 0 ~ 0 0 0 


. Thus Xj = (3/2)x 2 and 


x 2 is free. The general solution is 


3/2 3 

to 4 is . Another choice is 

1 2 


xJ I" (3/ 2 )x 2 1 r 3/2 


= x 2 .A basis for the eigenspace corresponding 


11 . A-10I = 


4-2 [10 0 _ -6 -2 
-3 9 ” 0 10 _ -3 -1 


The augmented matrix for (A - 1 0/)x = 0 is 


-6 -2 0] [1 1/3 0 
-3 -1 0 ~ 0 0 0 


Xjl [— (1/3 )x 2 1 [-1/3 


x 2 is free. The general solution is 


-1/3 -1 

corresponding to 10 is ^ . Another choice is 


. Thus x, = (-l/3)x, and 

) 0 Oj 1 2 

. A basis for the eigenspace 


12 . For >1 = 1: A-I = 


7 4 1 0 _ 6 4 

-3-1 0 1 ~ -3 -2 


6 4 0 1 2/3 0 

The augmented matrix for (A-I)x = 0 is ~ . Thus x, =(-2/3)x, and 

[-3 -2 Oj [0 0 0J 1 2 

[-2/31 [-2" 

x 2 is free. A basis for the eigenspace corresponding to 1 is ^ . Another choice is . 


For A = 5 : A-5I = 


7 4 5 0 _ 2 4 

-3 -1 ~ 0 5 _ -3 -6 
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The augmented matrix for (A-5I)x = 0 is 
The general solution is 


" 2 

4 0 " 


"1 

2 

0" 

-3 

1 

o 

so 

1 


0 

0 

0 


*1 


-2x 2 


2" 


— 


= x 2 


x 2 


x 2 


1 


|. Thus jcj = 2x 2 and x 2 is free. 
\-2 

A basis for the eigenspace is 


13 . For A, = 1: 



' 4 

0 

r 


"i 

0 

0" 


3 

0 

f 

li 

— l 

7 

-2 

1 

0 

- 

0 

1 

0 

= 

-2 

0 

0 


-2 

0 

i 


0 

0 

1 


-2 

0 

0 


The equations for (A — I)x = 0 are easy to solve: < 

[— 2jcj = 0 


Row operations hardly seem necessary. Obviously x x is zero, and hence x 3 is also zero. There are 
three-variables, so x 2 is free. The general solution of (A-I)x = 0 is x 2 e 2 , where e 2 =(0,1,0), and 
so e 2 provides a basis for the eigenspace. 

For X = 2: 



“ 4 

0 

f 


“2 

0 

0 " 


“ 2 

0 


f 






II 

*-1 

(N 

1 

-2 


1 

0 

- 

0 

2 

0 

= 

-2 

-1 


0 







-2 

0 

1 


0 

0 

2 


-2 

0 


1 









- 

2 

0 

1 

0 " 


"2 

0 

1 

0 “ 


CD 

0 

1/2 

0 " 

[(A — 21) 0 ] 

= 

- 

-2 

-1 

0 

0 

~ 

0 

-1 

1 

0 

~ 

0 

® 

-1 

0 




- 

-2 

0 

-1 

0 


0 

0 

0 

0 


0 

0 

0 

0 


So x x =-(l/2)x 3 , x 2 =x 3 , with x 3 free. The general solution of (A-2I)x = 0 is x 3 


- 1/2 

1 

1 


. A nice basis 


vector for the eigenspace is 


-1 

2 

2 


For X = 3: 



" 4 

o r 


“3 

0 

0 " 


1 

0 

f 





A-3I = 

-2 

1 0 

- 

0 

3 

0 

= 

-2 

-2 

0 






-2 

0 1 


0 

0 

3 


-2 

0 

-2 







i 

0 

1 

0 " 


"1 

0 1 

0 " 



0 

1 

0 " 

[(A -31) 

i 0] = 

-2 

-2 


0 

0 

~ 

0 

-2 2 

0 

~ 

0 

® 

-1 

0 



-2 

0 

-2 

0 


0 

0 0 

0 


0 

0 

0 

0 


-1 
1 . 
1 


So Xj = -jc 3 , x 2 = jc 3 , with x 3 free. A basis vector for the eigenspace is 



5.1 


Solutions 


261 





"1 

0 

-f 


"2 0 

0" 


"3 

0 

-f 


14. For X = -2: A- (-21) = 

A + 2I = 

1 


3 

0 

+ 

0 2 

0 

= 

1 

-1 

0 





4 

-13 

1 


0 0 

2 


4 

-13 

3 


The augmented matrix for [A - (-2)/]x = 

= 0. 

, or 

( A + 2I)\ = 0 , 

is 







"3 

0 -1 

0" 


"1 


0 

-1/3 

0" 


"1 

0 - 

-1/3 

0" 

[(A + 21) 0] = 

1 

-10 0 

~ 

0 


1 

-1/3 

0 

~ 

0 

1 - 

-1/3 

0 


4 

-13 3 

i 0 


0 

-13 

13/3 

0 


0 

0 

0 

0 


Thus jCj = (l/3)x 3 ,x 2 = (l/3)x 3 , with x 3 free. The general solution of (A + 2 1)x = 0 is x 3 


1/3 

1/3 . 
1 


A basis for the eigenspace corresponding to -2 is 


"1/3" 


“l" 

1/3 

; another is 

l 

1 


3 


15. For T = 3: [(A -31) 0] = 


1 

2 

3 

O' 


"1 

2 

3 

0" 

-1 

-2 

-3 

0 

~ 

0 

0 

0 

0 

2 

4 

6 

0 


0 

0 

0 

0 


. Thus jfj + 2x 2 + 3x 3 = 0, with x 2 and 


x 3 free. The general solution of ( A - 3/)x = 0, is 



-2x 2 - 3x 3 


"-2" 


"-3" 



~-2" 


"-3" 


x = 

x 2 

= x 2 

1 

+ x 3 

0 

. Basis for the eigenspace : < 


1 


0 



x 3 


0 


1 



0 


1 



Note: For simplicity, the text answer omits the set brackets. 1 permit my students to list a basis without the set 
brackets. Some instructors may prefer to include brackets. 


16. For X = 4: A -41 = 


"3 

0 

2 

0 " 


"4 

0 

0 

0 " 


"-1 

0 

2 

0 " 

1 

3 

1 

0 


0 

4 

0 

0 


1 

-1 

1 

0 

0 

1 

1 

0 


0 

0 

4 

0 


0 

1 

-3 

0 

0 

0 

0 

4 


0 

0 

0 

4 


0 

0 

0 

0 


"-1 

0 

2 

0 

0 " 


"1 

0 

-2 

0 

0 " 

1 

-1 

1 

0 

0 


0 

1 

-3 

0 

0 

0 

1 

-3 

0 

0 


0 

0 

0 

0 

0 

0 

0 

0 

0 

0 


0 

0 

0 

0 

0 


[(A - 41) 0] = 


free variables. The general solution of (A -4/)x = 0 is 


So x l =2 x 3 ,x 2 = 3 x 3 , with x 3 and x 4 


*1 


2x 3 


"2" 


"0" 



"2" 


"0" 


X, 


3x, 


3 


0 



3 


0 



= 


= x 3 

1 

+ x 4 

0 

. Basis for the eigenspace : 


1 

? 

0 


x 3 


x 3 






X 4_ 


*4 


0 


1 



0 


1 



Note: 1 urge my students always to include the extra column of zeros when solving a homogeneous system. 
Exercise 16 provides a situation in which failing to add the column is likely to create problems for a student, 
because the matrix A -41 itself has a column of zeros. 
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17. The eigenvalues of 


18. The eigenvalues of 


0 0 
0 2 


0 0-1 


4 0 
0 0 
1 0 


0 

0 

-3 


are 0, 2, and -1, on the main diagonal, by Theorem 1. 


are 4, 0, and -3, on the main diagonal, by Theorem 1 . 


19. The matrix 


is not invertible because its columns are linearly dependent. So the number 0 is 


1 2 3 

1 2 3 

1 2 3 

an eigenvalue of the matrix. See the discussion following Example 5. 

'5 5 5" 

I 

is not invertible because its columns are linearly dependent. So the number 0 


20. The matrix A = 


5 5 5 

5 5 5 

is an eigenvalue of A. Eigenvectors for the eigenvalue 0 are solutions of Ax = 0 and therefore have 
entries that produce a linear dependence relation among the columns of A. Any nonzero vector (in R 3 ) 
whose entries sum to 0 will work. Find any two such vectors that are not multiples; for instance, 

(1, 1,-2) and (1,-1, 0). 


21. a. False. The equation Ax = Xx must have a nontrivial solution. 

b. True. See the paragraph after Example 5. 

c. True. See the discussion of equation (3). 

d. True. See Example 2 and the paragraph preceding it. Also, see the Numerical Note. 

e. False. See the warning after Example 3. 

22. a. False. The vector x in Ax = Xx must be nonzero. 

b. False. See Example 4 for a two-dimensional eigenspace, which contains two linearly independent 
eigenvectors corresponding to the same eigenvalue. The statement given is not at all the same as 
Theorem 2. In fact, it is the converse of Theorem 2 (for the case r = 2). 

c. True. See the paragraph after Example 1. 

d. False. Theorem 1 concerns a triangular matrix. See Examples 3 and 4 for counterexamples. 

e. True. See the paragraph following Example 3. The eigenspace of A corresponding to X is the null 
space of the matrix A - XI. 

23. If a 2x2 matrix A were to have three distinct eigenvalues, then by Theorem 2 there would correspond 
three linearly independent eigenvectors (one for each eigenvalue). This is impossible because the vectors 
all belong to a two-dimensional vector space, in which any set of three vectors is linearly dependent. See 
Theorem 8 in Section 1.7. In general, if an nxn matrix has p distinct eigenvalues, then by Theorem 2 
there would be a linearly independent set of p eigenvectors (one for each eigenvalue). Since these vectors 
belong to an /7-dimensional vector space,// cannot exceed n. 


24. A simple example of a 2x2 matrix with only one distinct eigenvalue is a triangular matrix with the 
same number on the diagonal. By experimentation, one finds that if such a matrix is actually a diagonal 
matrix then the eigenspace is two dimensional, and otherwise the eigenspace is only one dimensional. 


4 

0 



5 

4 ' 


Examples: 
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25. If A is an eigenvalue of A, then there is a nonzero vector x such that Ax = Ax. Since A is invertible, 
A~ l Ax = A~ l (Xx), and so x = X(A~ l x). Since x^O (and since A is invertible), A cannot be zero. Then 
A~ 1 x = H~ 1 x, which shows that A -1 is an eigenvalue of A~ l . 

Note: The Study Guide points out here that the relation between the eigenvalues of A and A~ l is important in 
the so-called inverse power method for estimating an eigenvalue of a matrix. See Section 5.8. 

26. Suppose that A 2 is the zero matrix. If Ax = Ax for some x 0, then A 2 x = A(Ax) = A( Ax) = A Ax = A 2 x. 
Since x is nonzero, A must be nonzero. Thus each eigenvalue of A is zero. 

27. Use the Hint in the text to write, for any A, (A - A I) T = A 1 - (A I) T = A r - A I. Since (A - A I) T is invertible 
if and only if A -XI is invertible (by Theorem 6(c) in Section 2.2), it follows that A T -XI is not 
invertible if and only if A - XI is not invertible. That is, A is an eigenvalue of A 1 if and only if A is an 
eigenvalue of A. 

Note: If you discuss Exercise 27, you might ask students on a test to show that A and A 1 have the same 
characteristic polynomial (discussed in Section 5.2). Since det A = det A r , for any square matrix A, 

det (A -XI) = det (A - X if = det( A 7 - (A I) T ) = det(d - XI). 

28. If A is lower triangular, then A r is upper triangular and has the same diagonal entries as A. Hence, by the 
part of Theorem 1 already proved in the text, these diagonal entries are eigenvalues of A T . By Exercise 
27, they are also eigenvalues of A. 

29. Let v be the vector in R" whose entries are all ones. Then Ax = sx. 

30. Suppose the column sums of an n x n matrix A all equal the same number 5. By Exercise 29 applied to 
A t in place of A, the number s is an eigenvalue of A T . By Exercise 27, s is an eigenvalue of A. 

31. Suppose T reflects points across (or through) a line that passes through the origin. That line consists of all 
multiples of some nonzero vector v. The points on this line do not move under the action of A. So 

T (v) = v. If A is the standard matrix of T, then Ay = v. Thus v is an eigenvector of A corresponding to 
the eigenvalue 1 . The eigenspace is Span {v} . Another eigenspace is generated by any nonzero vector u 
that is perpendicular to the given line. (Perpendicularity in R 2 should be a familiar concept even though 
orthogonality in R" has not been discussed yet.) Each vector x on the line through u is transformed into 
the vector -x. The eigenvalue is -1. 

33. (The solution is given in the text.) 

a. Replace A' by k + 1 in the definition of x k , and obtain x A . +1 =c 1 i / ' +l u + c 2 // / ' +1 v. 

b. Ax k = A(c v l k n + c 2 /u k v) 

= c t A k Au + c 2j u k Ax by linearity 
= c, A k Au + c 2 u k u v since u and v are eigenvectors 
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34. You could try to write x 0 as linear combination of eigenvectors, Vj,...,v . If are 

corresponding eigenvalues, and if x 0 = CjVj H — + c p \ p , then you could define 

x /c = + • • • + C p ApV p 

In this case, for k = 0, 1, 2, ..., 

Ax k = A(c 1 Jfv l +--- + c p A k p \ p ) 

= CfA^Av, 4 — + c p A p Av p Linearity 
= Cj^Vj H — + c A* +1 v The v ; are eigenvectors. 

= x *+i 

35. Using the figure in the exercise, plot T(u) as 2u, because u is an eigenvector for the eigenvalue 2 of the 
standard matrix A. Likewise, plot T{\) as 3v, because v is an eigenvector for the eigenvalue 3. Since T 
is linear, the image ofw is T{ w) =r(u + v) = T(u) + T(\). 

36. As in Exercise 35, r(u) = -u and T(\) = 3v because u and v are eigenvectors for the eigenvalues 
-1 and 3, respectively, of the standard matrix A. Since T is linear, the image of w is 

r(w) = r(u + v) =r(u) + r(v). 

Note: The matrix programs supported by this text all have an eigenvalue command. In some cases, such as 
MATLAB, the command can be structured so it provides eigenvectors as well as a list of the eigenvalues. At 
this point in the course, students should not use the extra power that produces eigenvectors. Students need to 
be reminded frequently that eigenvectors of A are null vectors of a translate of A. That is why the instructions 
for Exercises 35-38 tell students to use the method of Example 4. 

It is my experience that nearly all students need manual practice finding eigenvectors by the method of 
Example 4, at least in this section if not also in Sections 5.2 and 5.3. However, [M] exercises do create a 
burden if eigenvectors must be found manually. For this reason, the data files for the text include a special 
command, nulbasis for each matrix program (MATLAB, Maple, etc.). The output of nulbasis (A) is 
a matrix whose columns provide a basis for the null space of A, and these columns are identical to the ones a 
student would find by row reducing the augmented matrix [A 0], With nulbasis, student answers will be the 
same (up to multiples) as those in the text. I encourage my students to use technology to speed up all 
numerical homework here, not just the [M] exercises, 

37. [M] Let A be the given matrix. Use the MATLAB commands eig and nulbasis (or equivalent 
commands). The command ev = eig (A) computes the three eigenvalues of A and stores them in a 
vector ev . In this exercise, ev = (3, 13, 13). The eigenspace for the eigenvalue 3 is the null space of 
A - 31. Use nulbasis to produce a basis for each null space. If the format is set for rational display, 
the result is 

' 5/9 

nulbasis (A - ev (1)* eye (3 )) = -2/9 

1 

5 

For simplicity, scale the entries by 9. A basis for the eigenspace for A = 3 : -2 

9 
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For the next eigenvalue, 13, compute nulbasis(A - ev (2 )* eye (3 ) ) = 


-2 -1 

1 0 

0 1 




'-2" 


"-1" 


Basis for eigenspace for A = 13 : < 


1 

9 

0 




0 


1 



There is no need to use ev ( 3 ) because it is the same as ev ( 2 ) . 

38. [M] ev = eig (A) = (13, -12, -12, 13). ForT = 13: 



'-1/2 

1/3 ' 



'-f 


f 



0 

-4/3 

. Basis for eigenspace : • 


0 


-4 


nulbasis (A - ev ( 1 )* eye (4 ) ) = 

1 

0 


2 

9 

0 



0 

1 



0 


3 



For A = -12 : nulbasis (A - ev (2 )* eye (4 ) ) = 


"2/7 

O' 



'2' 


' O' 


1 

-1 

. Basis: • 


7 


-1 


1 

0 



7 


0 


0 

1 



0 


1 



39. [M] For A = 5, basis: 


'-1' 


'2' 




'-2' 


3' 


1 


0 




7 


7 


0 

9 

0 


-. For A. = -2, basis: - 


-5 

9 

-5 


1 


0 




5 


0 


0 


1 




_ 0 


5_ 



40. [M] ev = eig (A) = (21.68984106239549,-16.68984106239549,3,2,2). The first two eigenvalues are 
the roots of A 2 - 5A - 362 = 0. 


Basis for A = ev(l) : 


—0.33333333333333 


—0.33333333333333 

2.39082008853296 


-0.80748675519962 

0.33333333333333 

, for A = ev(2) : 

0.33333333333333 

0.58333333333333 


0.58333333333333 

1.000000000000000 


1.00000000000000 


For the eigenvalues 3 and 2, the eigenbases are 


" o' 



'-2' 


'-.5' 


-2 



1 


.5 


0 

, and • 


0 

9 

0 


1 



1 


0 


0 



0 


1 



, respectively. 


Note: Since so many eigenvalues in text problems are small integers, it is easy for students to form a habit of 
entering a value for A in nulbasis (A-Al) based on a visual examination of the eigenvalues produced by 
eig (A) when only a few decimal places for A are displayed. Exercise 40 may help your students discover 
the dangers of this approach. 



266 CHAPTER 5 • Eigenvalues and Eigenvectors 


5.2 SOLUTIONS 

Notes: Exercises 9-14 can be omitted, unless you want your students to have some facility with determinants 
of 3x3 matrices. In later sections, the text will provide eigenvalues when they are needed for matrices larger 
than 2x2. If you discussed partitioned matrices in Section 2.4, you might wish to bring in Supplementary 
Exercises 12-14 in Chapter 5. (Also, see Exercise 14 of Section 2.4.) 

Exercises 25 and 27 support the subsection on dynamical systems. The calculations in these exercises and 
Example 5 prepare for the discussion in Section 5.6 about eigenvector decompositions. 



"2 7' 

1 

x, 

■ — i 

il 

"2 7' 


~ A 

0 " 


~2-A 7 

1. A = 

7 2 

7 2 

— 

0 

A 

— 

7 2 -A 


. The characteristic polynomial is 

det(/f-?i/) = (2-?i) 2 -7 2 =4-4?i + ?i 2 -49 = ^ 2 -4?i-45 
In factored form, the characteristic equation is (X - 9)(A, + 5) = 0, so the eigenvalues of A are 9 and -5. 


2 . A = 


'5 3 

3 5 


, A- AI = 


. The characteristic polynomial is 


5-A 3 

3 5-A 

—i 

det(A-Al) = (5-A)(5-A)-3-3 = A 2 -10A+16 
Since A 2 -10A + 16 = (A-8)(A-2), the eigenvalues of A are 8 and 2. 


3 . A = 


'3 -2 

1 -1 


, A- AI = 


' 3 -A -2 
1 -1 -A 


. The characteristic polynomial is 


det (4 - AI) = (3 - XX-1 - X) - (-2)(1) = A 2 -2A -l 
Use the quadratic formula to solve the characteristic equation and find the eigenvalues: 
—b ± Jb 2 —4 ac 2 + v/4 + 4 


4 . A = 


A=- 

' 5 -3 

-4 3 


2 a 

, A-AI = 


- = l + v/2 


'5-A -3 ' 

-4 3- A 


. The characteristic polynomial of A is 


det ( A - AI) = (5 - A)(3 - A) - (-3)(-4) = A 2 -8A+3 
Use the quadratic formula to solve the characteristic equation and find the eigenvalues: 

L 4 ±va 


5 . A = 


. The characteristic polynomial of A is 


2 1 2-A 1 

, A- AI = 

-1 4j |_ - 1 

det (A - AI) = (2 - X)(4 - A) - (1)(— 1) = ^ 2 - 6A + 9 = (A - 3) 2 
Thus, A has only one eigenvalue 3, with multiplicity 2. 

3- A -4 ' 

4 8-/1 


6 . A = 


3 -4 

4 8 


, A- AI = 


. The characteristic polynomial is 


det (A -AI) = (3 -A)(8-A)~ (-4)(4) = A 2 - 1 1 A + 40 
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Use the quadratic formula to solve det (A - Al) = 0 : 

-ll±Vl21-4(40) _ -ll±V^39 
2 2 

These values are complex numbers, not real numbers, so A has no real eigenvalues. There is no nonzero 
vector x in R 2 such that Ax = Ax, because a real vector Ax cannot equal a complex multiple of x. 


-4 4 


,A — Al = 


5 -A 3 
-4 4 -A 


. The characteristic polynomial is 


det (A - Al ) = (5 - A)( 4 -A)- (3)(-4) = A 2 - 9 A + 32 
Use the quadratic formula to solve det (A - Al) = 0 : 

9 ±^8 1-4(32) _ 9 ± 4-41 
2 2 

These values are complex numbers, not real numbers, so A has no real eigenvalues. There is no nonzero 
vector x in R 2 such that Ax = Ax, because a real vector Ax cannot equal a complex multiple of x. 


7 -2 


,A — Al = 


1 -A -2 
2 3-A 


. The characteristic polynomial is 


det (A - Al) = (7 - A)( 3 - A) - (— 2)(2) = l 2 -101 + 25 


Since l 2 - 10 A + 25 = (A - 5) 2 , the only eigenvalue is 5, with multiplicity 2. 


1 -A 0 -1 " 

9. det(A-Al) = det 2 3-A -1 . From the special formula for 3 x 3 determinants, the 

0 6 0 -A 

characteristic polynomial is 

det (A -AI) = (1 - A)(3 - A)(-A) + 0 + (— 1)(2)(6) - 0 - (6)(-l)(l -A)- 0 
= (A 2 -4A + 3 )(-A ) -12 + 6(1 -A) 

= -A 3 + 4A 2 - 3A - 12 + 6 - 6A 
= -A 3 + 4A 2 —9 A— 6 

(This polynomial has one irrational zero and two imaginary zeros.) Another way to evaluate the 
determinant is to interchange rows 1 and 2 (which reverses the sign of the determinant) and then make 
one row replacement: 



"1-1 

0 

-1 ' 


2 3-1 -1 1 

det 

2 

3-1 

-1 

= - det 

7 

o 

1 


0 

6 

0-1 


1 

O 

so 

o 

1 


"2 3-A -1 

= -det 0 0+(.5l-.5)(3-l) -l + (.5l-.5)(-l) 

0 6 0-A 

Next, expand by cofactors down the first column. The quantity above equals 

f(.5A-.5)(3-A) -.5 -.511 „ „ „ 

-2 det „ =-2[(.5l-.5)(3 -!)(-!)- (-.5 -.5l)(6)] 

6 -A 

= (1 - A)(3-A)(-A) - (1 + A)(6) = (A 2 - 4A+3)(-A) - 6 - 6 A = -A 3 + 4 A 2 - 9 A- 6 
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0-A 3 


10. de\.{A- Al) = det 


3 

1 


0-/1 

2 


1 

2 

0-/1 


From the special formula for 3x3 determinants, the 


characteristic polynomial is 

det(^4 - Al) = (-A)(-A)(-A) + 3-2-1 + 1-3-2 — 1- (-A) • 1 - 2 • 2 • (-A) - (-A) -3-3 


— — A + 6 + 6 + A + 4A + 9 A — — A~ + 14.T + 12 


11. The special arrangements of zeros in A makes a cofactor expansion along the first row highly effective. 



O 

o 

1 



det(A-Al ) = det 

5 3-A 2 

= (4 -A) det 

"3-/1 2 

0 2-A_ 


-2 0 2-A 



= (4 - A)(3 - A,)(2 - A) = (4 - i)(/l 2 - 5i + 6) = -i 3 + 9 A 2 - 26A + 24 

If only the eigenvalues were required, there would be no need here to write the characteristic polynomial 
in expanded form. 


12. Make a cofactor expansion along the third row: 



~-l-A 0 1 



det(A-Al) = det 

-3 4-A 1 

= (2 - A) ■ det 

"-1-/1 0 

-3 4-A 


1 

<N 

O 

O 




= (2 - A ){-\ - A)(4 -A) = -A 3 + 5A 2 - 2A - 8 


13. Make a cofactor expansion down the third column: 

6- A -2 0 


det(^4 - Al) = det 


-2 

5 


9 -A 


0 

3-A 


= (3-/1) -det 


6-A -2 ' 

-2 9- A 


= (3 - A)[(6 - A)( 9 -A)- ( — 2)( — 2)] = (3 - A)(A 2 -15/1 + 50) 
= -A 3 + 1 8 A 2 - 95 A + 1 50 or (3 - /!)(/! - 5)(A - 1 0) 


14. Make a cofactor expansion along the second row: 



~5-A -2 3 



det(A-Al) = det 

0 1-A 0 

= (1 - A) ■ det 

"5 -A 3 

6 -2-A 


6 7 -2-A 




= (1 - A) ■ [(5 - A)(-2 - A) - 3 • 6] = (1 - A)(A 2 - 3A- 28) 
= -A 3 + 4A 2 +25/1-28 or (1 -/!)(/!- 7)(A+ 4) 


15. Use the fact that the determinant of a triangular matrix is the product of the diagonal entries: 


4 -A 


det(A-Al) = det 


0 

0 

0 


-7 0 

3-A -4 

0 3-A 

0 0 


2 

6 


1-/1 


(4-/l)(3-/l) 2 (l-/l) 


The eigenvalues are 4, 3, 3, and 1. 
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16. The determinant of a triangular matrix is the product of its diagonal entries: 

~5-X 0 0 0 

8 -4-/1 0 0 „ „ 

det(A -Al) = det ^ ^ \ A 0 = _ - /l)(l - /l) 2 

1 -5 2 1-A 

The eigenvalues are 5, 1, 1, and -4. 

17. The determinant of a triangular matrix is the product of its diagonal entries: 

"3-/1 0 0 0 0 

-5 1-/1 0 0 0 

3 8 0-/1 0 0 =(3-/l) 2 (l-/l) 2 (-/l) 

0-7 2 1-/1 0 

-4 1 9-2 3-/1 

The eigenvalues are 3, 3, 1, 1, and 0. 

18. Row reduce the augmented matrix for the equation (A - 5/)x = 0 : 

"0 -2 6 -1 0] [0 -2 6 -1 0] [0 1 -3 0 0" 

0-2 h 0 0 0 0 h- 6 1 0 0 0 h- 6 0 0 

0 00 4 0 ~ 0 0 0 4 0 ~ 0 0 0 10 

0 0 0 -4 oj [o 0 0 4 0 J |_0 0 0 0 0 

For a two-dimensional eigenspace, the system above needs two free variables. This happens if and only 
if h = 6. 

19. Since the equation det (A - XI) = (X ] - X)(X 2 - X) ■ ■ ■ (X n - X) holds for all X , set X = 0 and conclude that 
detA = X l X 2 ■■■X ir 

20 . det(A T -Xl) = det(A T -XI T ) 

= det (A - Xl) T Transpose property 

= det (A - Al) Theorem 3(c) 

21. a. False. See Example 1. 

b. False. See Theorem 3. 

c. True. See Theorem 3. 

d. False. See the solution of Example 4. 

22. a. False. See the paragraph before Theorem 3. 

b. False. See Theorem 3. 

c. True. See the paragraph before Example 4. 

d. False. See the warning after Theorem 4. 

23. If A = QR, with Q invertible, and if A, = RQ, then write A x = Q l QRQ = Q~'AQ, which shows that 
A x is similar to A. 
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24. First, observe that ifF* is invertible, then Theorem 3(b) shows that 

1 = det/ = det(F > F >_1 ) = (detP)(detP -1 ) 

Use Theorem 3(b) again when A = PBP 1 , 

det A = det (PBP 1 ) = (detF , )(det5)(detF >_1 ) = (deti?)(detF , )(detF , ~ 1 ) = deti? 

25. Example 5 of Section 4.9 showed that Av 1 = v, , which means that V[ is an eigenvector of A 
corresponding to the eigenvalue 1 . 

a. Since A is a 2x2 matrix, the eigenvalues are easy to find, and factoring the characteristic 
polynomial is easy when one of the two factors is known. 

6/1 3 

det ' ' = (.6 - A)(.7 -A)- (.3)(.4) = A 2 -l.3A+3 = (A- Y)(A- .3) 

.4 .7 — A 

The eigenvalues are 1 and .3. For the eigenvalue .3, solve ( A-.3I)x = 0 : 

.6-3 .3 0]J.3 .3 0] [1 1 0" 

.4 .7-. 3 Oj _ [.4 .4 Oj ~ [o 0 0_ 

Here x l -x 2 = 0, with x 2 free. The general solution is not needed. Set x 2 = 1 to find an eigenvector 

"-ll 2 

v 2 = .A suitable basis for R“ is {v 1 ,v 2 }. 


b. Write x 0 = v, + cv 2 : 


1/2 3/7 -1 

1 = +c ^ . By inspection, c is -1/14. (The value of c depends on 


how v 2 is scaled.) 

c. For k = 1,2,..., define x k = A k x 0 . Then =A(\ l +cx 2 ) = Ax l +cAx 2 =v, +c(.3)v 2 , because Vj 
and v 2 are eigenvectors. Again 

x 2 =Ax l =A(y 1 +c(.3)v 2 ) = A\ i +c(3)A\ 2 = \ l +c(.3)(.3)v 2 . 


Continuing, the general pattern is x k = v, +c(.3) A v 2 . As k increases, the second term tends to 0 and 
so x k tends to Vj. 



a b 

, =U, and det A = {a){d-ca b) = ad -be. If a = 0, then 

_0 d —ca~ l b_ 



= U (with one interchange), so det A = (-1) 1 (cb) = 0-bc = ad -be. 


27. a. A\ l = \ l , Av 2 =. 5v 2 , Ay 3 =. 2v 3 . 

b. The set {v 1 ,v 2 ,v 3 } is linearly independent because the eigenvectors correspond to different 
eigenvalues (Theorem 2). Since there are three vectors in the set, the set is a basis for 1 3 . So there 
exist unique constants such that x 0 = c, v, +c 2 v 2 +c 3 v 3 , and w r x 0 =CjW r Vj +c 2 w r v 2 +c 3 w r v 3 . 
Since x 0 and v, are probability vectors and since the entries in v 2 and v 3 sum to 0, the above 
equation shows that q = 1 . 

c. By (b), x 0 = CjV, +c 2 v 2 +c 3 v 3 . Using (a), 

x k =A k x 0 =c l A k \ x +c 2 A k \ 2 +c 3 A k \ 3 = Vj +c 2 (.5) A v 2 +c 3 (.2) A v 3 — >Vj as 
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28. [M] 

Answers will vary, but should show that the eigenvectors of A are not the same as the eigenvectors 
of A 7 , unless, of course, A T = A. 

29. [M] Answers will vary. The product of the eigenvalues of A should equal det A. 

30. [M] The characteristic polynomials and the eigenvalues for the various values of a are given in the 

following table: 


a 

Characteristic Polynomial 

Eigenvalues 

31.8 

-.4-2.6? + 4? 2 -? 3 

3.1279, 1, - .1279 

31.9 

.8-3.8? + 4? 2 -? 3 

2.7042, 1, .2958 

32.0 

2-5? + 4? 2 -? 3 

2, 1, 1 

32.1 

3.2- 6.2? + 4? 2 -? 3 

1.5 + .9747?, 1 

32.2 

4.4- 7.4? + 4? 2 -? 3 

1.5 ± 1.4663?, 1 


The graphs of the characteristic polynomials are: 



a=31 .8 

a=31.9 

a=32.0 

a=32.1 

a=32.2 


Notes: An appendix in Section 5.3 of the Study Guide gives an example of factoring a cubic polynomial with 
integer coefficients, in case you want your students to find integer eigenvalues of simple 3x3 or perhaps 
4x4 matrices. 

The MATLAB box for Section 5.3 introduces the command poly (A) , which lists the coefficients of 
the characteristic polynomial of the matrix A, and it gives MATLAB code that will produce a graph of the 
characteristic polynomial. (This is needed for Exercise 30.) The Maple and Mathematica appendices have 
corresponding information. The appendices for the TI and HP calculators contain only the commands that list 
the coefficients of the characteristic polynomial. 
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5.3 SOLUTIONS 


l. p = 


5 

2 


and A 4 


,A = PDP~\ and A 4 = PD 4 P~ l . 


'5 

7' 

"16 

0" 

3 

-1 


"226 

-525" 

2 

3 

0 

1 

-2 

5_ 


90 

-209 



We compute P 1 


3 

-2 


,D 4 = 


16 

0 


0 

1 ’ 



" 2 -3" 


"1 0 " 

2 . P = 

-3 5_ 

,D = 

0 1/2 


,A = POP \ 


p- 1 = 


5 3 
3 2 


,D 4 = 


1 0 
0 1/16 


and A 4 = 


and A 4 =PD 4 P 1 . We compute 


" 2 

-3" 

"1 

0 ' 

"5 

3" 

-3 

5_ 

0 

1/16 

3 

2 


1 

16 


151 

-225 





"1 

0" 

r k 

a 

0 

1 

0" 


k 

a 

0^ 


A k 

= PD k P ~ 1 = 







= 






3 

1 

0 

b k 

|_-3 

1 


3a k -3b k 

b k 




"3 

4" 

2 k 

0 

"-1 

4 


4 - 3 • 2 k 

12 -2* — 12 

A k 

= PD k P ~ 1 = 







= 






1 

1 

0 

\ k 

1 

-3 


l-2 k 

4-2 A -3 


5. By the Diagonalization Theorem, eigenvectors form the columns of the left factor, and they correspond 
respectively to the eigenvalues on the diagonal of the middle factor. 


T 


f 


' 2" 

1 

;X = 1: 

0 


-1 

1 


-1 


0 


6. As in Exercise 5, inspection of the factorization gives: 


'si- 

ll 

"-1" 

2 

ii 

'(N O 
1 

I 


"O' 

1 


0 


l 


0 


7 . Since A is triangular, its eigenvalues are obviously ±1. 
"0 0 
6 -2 


ForX= 1: A-1I = 


x 2 free. The general solution is x 2 
For A, = -1: A + 1I = 


1/3 

1 


2 0 
6 0 


The general solution is x 2 


From V! and v 2 construct F’ = |^v 1 v 2 ] = 

correspond to and v 2 respectively. 


. The equation (J-l/)x = 0 amounts to 6;q-2x 2 =0, so Xj=(1/3)x 2 with 

, and a nice basis vector for the eigenspace is v, = 

. The equation (A + l/)x = 0 amounts to 2x x = 0, so x x = 0 with x 2 free. 

and a basis vector for the eigenspace is v 2 = 

j i 

. Then set D = \ 


1 0 
3 1 


1 0 
0 -1 


where the eigenvalues in D 
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8. Since A is triangular, its only eigenvalue is obviously 5. 

„ To ll 

For A = 5 : A — 5I=^ ^ . The equation (A - 5/)x = 0 amounts to x 2 =0, so x 2 = 0 with x x free. The 

f ll 2 

general solution is jq . Since we cannot generate an eigenvector basis for t , A is not diagonalizable. 


9 . To find the eigenvalues of A, compute its characteristic polynomial: 

~3~X —1 

det (A - U) = det = (3 - X)(5 - X) - (— 1)(1) = l 2 - 8A + 1 6 = (X - 4) 2 

1 5 - A. 

Thus the only eigenvalue of A is 4. 

, [- 1 -ll 

For A = 4 : A — 4I = . The equation ( A - 4/)x = 0 amounts to x ] +x 2 =0, so jq = -x 2 with x 2 


free. The general solution is x 2 . Since we cannot generate an eigenvector basis for , A is not 
diagonalizable. 


10 . To find the eigenvalues of A, compute its characteristic polynomial: 

2 — A, 3 ~ 

det (A -7J) = det = (2 - A)(l - X) - (3)(4) = A 2 -3A,-10 = (A- 5)(A + 2) 

4 1 — A, 

Thus the eigenvalues of A are 5 and -2 . 

, r-3 3 i 

For A, = 5 : A - 51 = . The equation (A - 5/)x = 0 amounts to jq - x 2 = 0, so jc, = x 2 with x 2 

r in rr 

free. The general solution is x 2 , and a basis vector for the eigenspace is Vj = . 

, r 4 3 i 

For A, = -2 : A + 21 = ^ . The equation (A + l/)x = 0 amounts to 4jq + 3x 2 = 0, so x x = (~3/4)x 2 

[-3/41 [-3 

with x 2 free. The general solution is x 2 , and a nice basis vector for the eigenspace is v 2 = 


1 -3 


From V! and v 2 construct P = | v, v 2 J= ^ ^ . Then set D = ^ ^ , where the eigenvalues in 


5 0 


D correspond to v, and v 2 respectively 


11. The eigenvalues of A are given to be 1, 2, and 3. 

f_4 4 _2l 


1 0 -1/4 0 


For X = 3 : A-3I = -3 1 0 , and row reducing \A-3I 0 ] yields 0 1 -3/4 0 . The 


-3 1 0 


0 0 0 0 


general solution is x 3 3/4 , and a nice basis vector for the eigenspace is v, = 3 



274 CHAPTER 5 • Eigenvalues and Eigenvectors 


For A = 2: A — 21 = 


-3 4 -2 

-3 2 0 

-3 1 1 


, and row reducing [A -21 0 ] yields 


1 0 -2/3 

0 1 -1 
0 0 0 



“2/3“ 


“2“ 

general solution is x 3 

1 

, and a nice basis vector for the eigenspace is v 2 = 

3 


1 


3 


solution is x. 



"-2 4 

-2" 


For A = 1: A-I = 

-3 3 

0 

, and row reducing [4-1/ 0 ] yields 


-3 1 

2 



10-10 
0 1-10 
0 0 0 0 


, and a basis vector for the eigenspace is v 3 = 


From Vj, v 2 and v 3 construct P = [y { v 2 v 3 ] = 

eigenvalues in D correspond to v 1; v 2 and v 3 respectively. 

12 . The eigenvalues of A are given to be 2 and 8. 

"-4 2 2" 


“1 

2 

f 


3 

3 

1 

. Then set D = 

4 

3 

1 



3 0 ( 
0 2 ( 
0 0 1 


For A. = 8: 4-8/ = 


2-4 2 

2 2-4 


, and row reducing [4-8/ 0 ] yields 


10-1 
0 1 -1 

0 0 0 



"l" 


T 

general solution is x 3 

1 

, and a basis vector for the eigenspace is Vj = 

1 


1 


1 


For A = 2: A-2I = 


2 2 2 
2 2 2 
2 2 2 


, and row reducing [A -21 0 ] yields 


1110 
0 0 0 0 
0 0 0 0 



"-1" 


“- 1 “ 

solution is x 2 

1 

+ x 3 

0 


0 


1 


, and a basis for the eigenspace is {v 2 , v 3 } = 



“-1" 


"-1" 



1 


0 



0 


1 



From v 1; v 2 and v 3 construct P = v, v 2 v 3 ] = 


1 -1 -1 

1 1 0 

1 0 1 

eigenvalues in D correspond to v 1; v 2 and v 3 respectively. 


. Then set D = 


8 0 
0 2 
0 0 


0 

0 . The 
0 


. The general 


, where the 


0 

0 . The 
0 


The general 


0 

0 , where the 
2 
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13 . The eigenvalues of A are given to be 5 and 1. 

“-3 2 -f 


For X = 5: A-5I = 


1 -2 -1 
-1 -2 -3 


, and row reducing \A — 5I 0 ] yields 


1 0 1 
0 1 1 
0 0 0 



"-1" 


"-1" 

solution is x 3 

-1 

, and a basis for the eigenspace is v, = 

-1 


1 


1 


ForX= 1: A — \I = 


1 2 -1 

1 2 -1 

-1 -2 1 


and row reducing \A — I 0 ] yields 


1 2 -1 

0 0 0 

0 0 0 



"-2" 


T 

solution is 

1 

+ x 3 

0 


0 


l 


and a basis for the eigenspace is {v 2 ,v 3 } = 


From v 1; v 2 and v 3 construct P = i'v, v 2 v 3 ] = 

eigenvalues in D correspond to v 1; v 2 and v 3 respectively. 
14 . The eigenvalues of A are given to be 5 and 4. 



'- 2 ' 


"f 



1 


0 



0 


1 



~-l 

-2 

l 


-1 

1 

0 

. Then set D = 

1 

0 

1 



solution is x , 


For X = 4: A- 41 - 



'-1 0 

-2 


For X = 5: A- 51 = 

2 0 

4 

, and row reducing \_A-5I 0 ] yields 


0 0 

0 



1 0 2 
0 0 0 
0 0 0 


" 0 " 



"-2" 

1 

+ x 3 

0 

0 



1 



ro 

0 


and a basis for the eigenspace is {Vj,v 2 } = 



2 " 


“ 0 “ 



0 

? 

1 



1 


0 



2 1 4 

0 0 1 


, and row reducing [A- 41 0 ] yields 


1 1/2 0 
0 0 1 
0 0 0 


solution is x 3 

"—1/2" 

1 

, and a nice basis vector for the eigenspace is v 3 = 

"-1" 

2 


0 


0 


From v 1; v 2 and v 3 construct P = | v, v 2 v 3 ] = 
eigenvalues in D correspond to v 1; v 2 and v 3 respectively. 


"-2 

0 

-1' 


0 

1 

2 

. Then set D = 

1 

0 

0 



0 

0 . The general 
0 


0 

0 . The general 
0 


0 0 

1 0 , where the 

0 1 


0 

0 . The general 
0 


0 

0 . The general 
0 


0 0 

5 0 , where the 

0 4 
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15. The eigenvalues of A are given to be 3 and 1. 

r 4 4 16] 


For X = 3 : A-3I= 2 2 8 

-2 -2 -8 

r-ii r-4i 


114 0 

and row reducing \A-3I 0] yields 0 0 0 0 . The general 

0 0 0 0 

r r-ii r-4i i 


solution is x 2 1 +x 3 0 , and a basis for the eigenspace is {Vj,v 2 } = < 1 , 0 

0 1 0 1 


6 4 16 

ForX= 1 : A-I = 2 4 8 

-2 -2 -6 


“1 0 2 0 " 

and row reducing \A-I 0] yields 0 110 . The general 

0 0 0 0 


solutionis x 3 -1 , and a basis for the eigenspace is v 3 = -1 . 


“-1 

-4 

-2] 

“3 

0 

0“ 

1 

0 

-1 . Then set D 

0 

3 

0 

0 

1 

1 

0 

0 

1 


the eigenvalues in D correspond to Vj,v 2 and v 3 respectively. 

16. The eigenvalues of A are given to be 2 and 1 . 

“-2 -4-6] [1 2 3 O' 

For X = 2 : A-2I = — 1 -2 -3 , and row reducing [A- 21 0] yields 0 0 0 0. The general 


I 1 2 3 

-2i r-3i 


[0 0 0 0 

-2i r-3i i 


solution is x 2 1 + x 3 0 , and a basis for the eigenspace is {Vj,v 2 } = < 1 , 0 

0 1 0 1 


-1 -4 -6 


10 2 0 


For X = 1 : A- 1 = - 1 -1 -3 , and row reducing A — I 0] yields 0 1 10. The general 


1 2 4 


0 0 0 0 


solutionis x 3 -1 , and a basis for the eigenspace is v 3 = -1 


“-2 

-3 

-2] 

“2 

0 

0“ 

1 

0 

-1 . Then set D = 

0 

2 

0 

0 

1 

lj 

0 

0 

1 


the eigenvalues in D correspond to Vj,v 2 and v 3 respectively. 
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17 . Since A is triangular, its eigenvalues are obviously 4 and 5. 



“0 

0 

0“ 


"1 

0 

0 

0" 

For X = 4: A- 41 = 

1 

0 

0 

, and row reducing [A- 41 0 ] yields 

0 

0 

1 

0 


0 

0 

1 


0 

0 

0 

0 


. The general 



“0“ 


“O" 

solution is x 2 

1 

, and a basis for the eigenspace is V[ = 

1 


0 


0 


Since X = 5 must have only a one-dimensional eigenspace, we can find at most 2 linearly independent 
eigenvectors for A, so A is not diagonalizable. 


18 . An eigenvalue of A is given to be 5; an eigenvector v, = 

corresponding to v l5 compute Av 1 = 
question is -3. 

For X = 5: A-5I = 


-2 

1 

2 


'-7 

-16 

4 

~-2 


' 6" 

6 

13 

-2 

1 

= 

-3 

12 

16 

1 

2 


6 


is also given. To find the eigenvalue 


= -3vj. Thus the eigenvalue in 


The general solution is x 2 


{v 2 ,v 3 } = 


-12 

-16 

4 



“1 4/3 -1/3 0" 

6 

8 

-2 

, and row reducing [A- 51 0 ] yields 

0 0 0 0 

12 

16 

-4 

1 


0 0 0 0 


"-4/3“ 


1/3" 



is x-, 

1 

+ x 3 

0 

, and a nice basis for the eigenspace is 


0 


1 





"-4" 


"f 



3 

? 

0 



0 


3 



From v 1; v 2 and v 3 construct P= v ] v 2 v 3 = 


"-2 

-4 

l" 


"-3 

0 

0" 

1 

3 

0 

. Then set D = 

0 

5 

0 

2 

0 

3 


0 

0 

5 


where the 


eigenvalues in D correspond to v, , v 2 and v 3 respectively. Note that this answer differs from the text. 
There, P = [v 2 v 3 v, ] and the entries in D are rearranged to match the new order of the eigenvectors. 
According to the Diagonalization Theorem, both answers are correct. 


19 . Since A is triangular, its eigenvalues are obviously 2, 3, and 5. 


For A, = 2: A- 21 = 


general solution is x 3 


"3 

-3 

0 

9 


0 

1 

1 

-2 

, and row reducing [A -21 0 ] yields 

0 

0 

0 

0 

0 

0 

0 

0 


"-1" 


"-1" 



-1 


2 



1 

+ x 4 

0 

, and a nice basis for the eigenspace is {v, , 

0 


1 




10 1 10 
0 11-20 
0 0 0 0 0 

0 0 0 0 0 


. The 



- 1 “ 


“- 1 " 


-1 


2 


1 

? 

0 


0 


1 
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ForX = 3: A — 3I = 


“2 

-3 

0 

9" 


“1 

-3/2 

0 

0 

0 " 

0 

0 

1 

-2 

, and row reducing \A -3/ 0 ] yields 

0 

0 

1 

0 

0 

0 

0 

-1 

0 

0 

0 

0 

1 

0 

0 

0 

0 

-1 


0 

0 

0 

0 

0 


The general solution is x 2 


3/2 

1 

0 

0 


and a nice basis for the eigenspace is v 3 = 


For X = 5: A-5I = 


“0 

-3 

0 

9" 


“0 

1 

0 

0 

0" 

0 

-2 

1 

-2 

, and row reducing [A- 51 0 ] yields 

0 

0 

1 

0 

0 

0 

0 

-3 

0 

0 

0 

0 

1 

0 

0 

0 

0 

-3_ 


0 

0 

0 

0 

0 


The 


general solution is x x 


and a basis for the eigenspace is v 4 = 



“-1 

-1 

3 

f 


“2 

0 

0 

0" 

From v 1 ,v 2 ,v 3 and v 4 construct P = [vj v 2 v 3 v 4 ] = 

-1 

2 

2 

0 

. Then set D = 

0 

2 

0 

0 

1 

0 

0 

0 


0 

0 

3 

0 


0 

1 

0 

0 


0 

0 

0 

5 


where the eigenvalues in D correspond to v,, v 2 and v 3 respectively. Note that this answer differs from 
the text. There, P = [ v 4 v 3 v, v 2 ] and the entries in D are rearranged to match the new order of the 
eigenvectors. According to the Diagonalization Theorem, both answers are correct. 

20 . Since A is triangular, its eigenvalues are obviously 4 and 2. 


For A, = 4: A- 41 = 


"0 

0 

0 

0 " 


"1 

0 

0 

-2 

0 " 

0 

0 

0 

0 

, and row reducing \A-4I 0 ] yields 

0 

0 

1 

0 

0 

0 

0 

-2 

0 

0 

0 

0 

0 

0 

1 

0 

0 

-2 


0 

0 

0 

0 

0 


The 


general solution is x 2 


0" 


" 2 " 



"0" 


" 2 " 


1 


0 

, and a basis for the eigenspace is {v 1; v 2 } = • 


1 


0 


0 

+ x 4 

0 


0 

9 

0 


0 


1 



0 


1 



For A = 2: A- 21 = 


"2 

0 

0 

0 " 


"1 

0 

0 

0 

0 " 

0 

2 

0 

0 

, and row reducing [A -21 0 ] yields 

0 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

1 

0 

0 

0 


0 

0 

0 

0 

0 


The 


general solution is x 3 


“ 0 “ 


“ 0 " 

0 

+ x 4 

0 

1 

0 

0 


1 


, and a basis for the eigenspace is {v 3 , v 4 } = 



" 0 " 


" 0 " 



0 


0 



1 

9 

0 



0 


1 
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0 2 0 0 

r . 1 0 0 0, 

From v.,v 9 ,v, and v 4 construct P= v, v, v, v, = . Then set D 

1 2 3 4 L 1 2 3 4J 0 0 1 0 

0 10 1 

where the eigenvalues in D correspond to Vj,v 2 and v 3 respectively. 

21. a. False. The symbol D does not automatically denote a diagonal matrix. 

b. True. See the remark after the statement of the Diagonalization Theorem. 

c. False. The 3x3 matrix in Example 4 has 3 eigenvalues, counting multiplicities, but it is not 
diagonalizable. 

d. False. Invertibility depends on 0 not being an eigenvalue. (See the Invertible Matrix Theorem.) 

A diagonalizable matrix may or may not have 0 as an eigenvalue. See Examples 3 and 5 for both 
possibilities. 

22. a. False. The n eigenvectors must be linearly independent. See the Diagonalization Theorem. 

b. False. The matrix in Example 3 is diagonalizable, but it has only 2 distinct eigenvalues. (The 
statement given is the converse of Theorem 6.) 

c. True. This follows from AP = PD and formulas (1) and (2) in the proof of the Diagonalization 
Theorem. 

d. False. See Example 4. The matrix there is invertible because 0 is not an eigenvalue, but the matrix is 
not diagonalizable. 

23. A is diagonalizable because you know that five linearly independent eigenvectors exist: three in the 
three-dimensional eigenspace and two in the two-dimensional eigenspace. Theorem 7 guarantees that the 
set of all five eigenvectors is linearly independent. 

24. No, by Theorem 7(b). Flere is an explanation that does not appeal to Theorem 7: Let v, and v 2 be 
eigenvectors that span the two one-dimensional eigenspaces. If v is any other eigenvector, then it belongs 
to one of the eigenspaces and hence is a multiple of either v, or v 2 . So there cannot exist three linearly 
independent eigenvectors. By the Diagonalization Theorem, A cannot be diagonalizable. 

25. Let {vj} be a basis for the one-dimensional eigenspace, let v 2 and v 3 form a basis for the two- 
dimensional eigenspace, and let v 4 be any eigenvector in the remaining eigenspace. By Theorem 7, 

{V|, v 2 , v 3 , v 4 } is linearly independent. Since A is 4x4, the Diagonalization Theorem shows that 
A is diagonalizable. 

26. Yes, if the third eigenspace is only one-dimensional. In this case, the sum of the dimensions of the 
eigenspaces will be six, whereas the matrix is 7x7. See Theorem 7(b). An argument similar to that for 
Exercise 24 can also be given. 

27. If A is diagonalizable, then A = PDP 1 for some invertible P and diagonal D. Since A is invertible, 0 is 
not an eigenvalue of A. So the diagonal entries in D (which are eigenvalues of A) are not zero, and D is 
invertible. By the theorem on the inverse of a product, 

a~ 1 = (PDP~ l y 1 = (p- l y 1 D~ l p-' = PD~ l P~ l 
Since D~ l is obviously diagonal, A' 1 is diagonalizable. 
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28. If. 4 has n linearly independent eigenvectors, then by the Diagonalization Theorem, A = PDP 1 for some 
invertible P and diagonal D. Using properties of transposes, 

A t = ( PDP x ) t = (P~' ) T d t p t 
= (P t )- 1 DP t = QDQ- ] 

where Q = ( P 1 ) _1 . Thus A 1 is diagonalizable. By the Diagonalization Theorem, the columns of Q are n 
linearly independent eigenvectors of A T . 

29. The diagonal entries in D { are reversed from those in D. So interchange the (eigenvector) columns of 
P to make them correspond properly to the eigenvalues in D { . In this case, 


Pi = 


1 1 

-2 -1 


and Dj = 


3 0 
0 5 


Although the first column of P must be an eigenvector corresponding to the eigenvalue 3, there is 


nothing to prevent us from selecting some multiple of 


1 

-2 


, say 


-3 

6 


and letting P 2 = 


-3 1 

6 -1 


. We 


now have three different factorizations or “diagonalizations” of A: 


A = PDP 1 = P x D x P x ~ l = P 2 D x P 2 

30. A nonzero multiple of an eigenvector is another eigenvector. To produce P 2 , simply multiply one or 
both columns of P by a nonzero scalar unequal to 1 . 

31. For a 2x2 matrix A to be invertible, its eigenvalues must be nonzero. A first attempt at a construction 

“2 3l 

, whose eigenvalues are 2 and 4. Unfortunately, a 2x2 matrix with 


-l 




might be something such as 


0 4 


two distinct eigenvalues is diagonalizable (Theorem 6). So, adjust the construction to 


2 3 
0 2 


which 


works. In fact, any matrix of the form 


a b 
0 a 


has the desired properties when a and b are nonzero. The 


eigenspace for the eigenvalue a is one-dimensional, as a simple calculation shows, and there is no other 
eigenvalue to produce a second eigenvector. 

32. Any 2x2 matrix with two distinct eigenvalues is diagonalizable, by Theorem 6. If one of those 

a b 


eigenvalues is zero, then the matrix will not be invertible. Any matrix of the form 


0 0 


has the 


desired properties when a and b are nonzero. The number a must be nonzero to make the matrix 

TO 0 

diagonalizable; b must be nonzero to make the matrix not diagonal. Other solutions are 


0 a 
0 b ‘ 


and 
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33 . 



4 

0 

-2 

4 


0 9 

1 6 

1 0 ’ 
0 7 


ev = eig(A) = (5,l,-2,-2) 


nulbasis (A-ev (1) *eye (4) ) = 


A basis for the eigenspace of X = 5 is 


1.0000 

0.5000 

-0.5000 

1.0000 

' 2 " 

1 

-1 ' 

2 


nulbasis (A-ev (2 ) *eye (4 ) ) 


1.0000 

-0.5000 

-3.5000 

1.0000 


A basis for the eigenspace of X = 1 is 


2 

-1 

-7 

2 


nulbasis (A-ev (3) *eye (4) ) = 


"1.0000" 


1.5000" 

1.0000 


-0.7500 

1.0000 

9 

0 

0 


1.0000 


A basis for the eigenspace of X = —2 is 


T 


“ 6" 

1 


-3 

1 

9 

0 

0 


_ 4_ 



' 2 

2 

1 

6" 


“5 

0 

0 

0" 


1 

-1 

1 

-3 


0 

1 

0 

0 

Thus we construct P = 

-1 

-7 

1 

0 

and D = 

0 

0 

-2 

0 


2 

2 

0 

4 


0 

0 

0 

-2 


34 . A = 


0 13 8 4 

4 9 8 4 

8 6 12 8 

0 5 0 -4_ 

ev = eig(A) = (-4,24, 1,-4) 
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nulbasis (A-ev (1) *eye (4) ) = 


A basis for the eigenspace of X = -4 is 


-1 

0 

0 

1 

-1 

0 

0 

1 


nulbasis (A-ev (2 ) *eye (4 ) ) = 


A basis for the eigenspace of X = 24 is 


nulbasis (A-ev (3) *eye (4) ) = 


A basis for the eigenspace of X = 1 is 


-2 
0 
1 
0 

-2 
0 
1 
0 

5.6000 

5.6000 

7.2000 

1.0000 

28 
28 
36 
5 

1.0000 

1.0000 

- 2.0000 

1.0000 

1 
1 

-2 

1 



'-2 

-1 

28 

f 


Thus we construct P = 

0 

0 

28 

1 

and D = 


1 

0 

36 

-2 



0 

1 

5 

1 



-4 ( 

0 

0 ( 
0 ( 


11 -6 4 -10 -4 

-3 5 -2 4 1 

35 . A = |-8 12-3 12 4 

1 6-2 3-1 

8 -18 8 -14 -1 

ev = eig (A) =(5,1, 3, 5,1) 


nulbasis (A-ev (1) *eye (5) ) = 


" 2.0000" 


1.0000" 

-0.3333 


-0.3333 

-1.0000 

? 

-1.0000 

1.0000 


0 

0 


1.0000 


0 0 
0 0 
24 0 

0 1 
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A basis for the eigenspace of X = 5 is 


nulbasis (A-ev (2) *eye (5) ) = 


A basis for the eigenspace of X = 1 is 


“ 6“ 


“ 3" 

-1 


-1 

-3 

9 

-3 

3 


0 

0 


3 


“ 0.8000" 


“ 0.6000" 

-0.6000 


-0.2000 

-0.4000 

9 

-0.8000 

1.0000 


0 

0 


1.0000 


' 4" 


3" 

-3 


-1 

-2 

9 

-4 

5 


0 

0 


5_ 


nulbasis (A-ev (3) *eye (5) ) 


0.5000 

-0.2500 

- 1.0000 

-0.2500 

1.0000 


A basis for the eigenspace of X = 3 is 


2 

-1 

-4 

-1 

4 


Thus we construct 


' 6 

3 

4 

3 

2 


“5 

0 

0 

0 

0 " 

-1 

-1 

-3 

-1 

-1 


0 

5 

0 

0 

0 

-3 

-3 

-2 

-4 

-4 

and D = 

0 

0 

1 

0 

0 

3 

0 

5 

0 

-1 


0 

0 

0 

1 

0 

0 

3 

0 

5 

4_ 


0 

0 

0 

0 

3_ 



' 4 

4 

2 

3 

-2 


0 

1 

-2 

-2 

2 

A = 

6 

12 

11 

2 

-4 


9 

20 

10 

10 

-6 


15 

28 

14 

5 

-3 

ev : 

= eig (A) 

= (3, 

5,7 

,5, 
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nulbasis (A-ev (1) *eye (5) ) 


“ 2.0000“ 


"-1.0000“ 

-1.5000 


0.5000 

0.5000 

9 

0.5000 

1.0000 


0 

0 


1.0000 


A basis for the eigenspace of X = 3 


nulbasis (A-ev (2) *eye (5) ) 


“ 4“ 


"-2“ 

-3 


1 

1 

9 

1 

2 


0 

0 


2 


0“ 


“-1.0000“ 

-0.5000 


1.0000 

1.0000 

9 

0 

0 


-1.0000 

0 


1.0000 


A basis for the eigenspace of X = 


“ 0“ 


“-1" 

-1 


1 

2 

9 

0 

0 


-1 

0 


1 


nulbasis (A-ev (3) *eye (5) ) 


0.3333 

0.0000 

0.0000 

1.0000 

1.0000 


A basis for the eigenspace of X = 7 is 


1 

0 

0 

3 

3 


Thus we construct 


“ 4 

-2 

0 

-1 

1“ 


“3 

0 

0 

0 

0“ 

-3 

1 

-1 

1 

0 


0 

3 

0 

0 

0 

1 

1 

2 

0 

0 

and D = 

0 

0 

5 

0 

0 

2 

0 

0 

-1 

3 


0 

0 

0 

5 

0 

0 

2 

0 

1 

3 


0 

0 

0 

0 

7_ 


Notes: For your use, here is another matrix with five distinct real eigenvalues. To four decimal places, they 
are 11.0654, 9.8785, 3.8238, -3.7332, and -6.0345. 
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6 

-8 

5 

-3 

0 

-7 

3 

-5 

3 

0 

-3 

-7 

5 

-3 

5 

0 

-4 

1 

-7 

5 

-5 

-3 

-2 

0 

8 


The MATLAB box in the Study Guide encourages students to use eig (A) and nulbasis to practice 
the diagonalization procedure in this section. It also remarks that in later work, a student may automate the 
process, using the command [P D] = eig (A) . You may wish to permit students to use the full power of 
eig in some problems in Sections 5.5 and 5.7. 


5.4 SOLUTIONS 


1. Since T^) = 3d 3 - 5d 2 ,[7’(b 1 )]^ = 
T(b 3 ) = 4d 2 implies that [7" (b 3 1]^ = 
D is [U ( b j )] D [T (b 2 )\ d [T (b 3 )] D ] = 

2. Since T(d 1 ) = 2b 1 -3^,17^)]* = 


3 

-5 

0 


. Likewise TXbj^-d! +6d 2 implies that [TOb^)^ = 


. Thus the matrix for T relative to B and 


-1 

6 


and 


3-10 
-5 6 4 


' 2 
-3 


. Likewise r(d 2 )=-4b, +5b 2 implies that [T(d 2 )] B = 


-4 

5 


Thus the matrix for T relative to D and B is [TXdJJ^ITfd-,)^ = 


2 -4 

-3 5 


3. a. Tfej) = 0b 1 -lb 2 +b 3 , T(e 2 ) = — lb 3 -0b 2 -lb 3 , T(e 3 ) = lbj -lb 2 +0b 



“ 0“ 


"-1" 


r 

b- [T(e,)] B = 

-1 

5 [2\ e 2)L — 

0 


-1 


1 


-1 


0 


c. The matrix for T relative to £ and B is [ [T(ej)] B [T(e 2 )] s [r(e 3 )] B ] = 


0 -1 1 

-1 0 -1 

1 -1 0 


4. Let £ = {ej,e 2 } be the standard basis for . Since [Lfb, XL = T(b 1 ) = 


,[T(b 2 )] £ =T(b 2 ) = 


-4 

-1 


and [T(b 3 )] £ =r(b 3 ) = 


, the matrix for Trelative to B and £ is [[r(bj)] f [T(b 2 )] f [T(b 3 )] f ] = 


2-4 5 

0 -1 3 ‘ 
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5. a. r(p) = (? + 5)(2-f + ? 2 ) = 10-3? + 4r + t 3 

b. Let p and q be polynomials in 2 , and let c be any scalar. Then 
T (p(t) + q(0) = (t + 5)[p(t) + q(t)] = (t + 5)p(f ) + (t + 5)q(f) 
= r(p(0) + T(q(0) 

T ( c • p(0) = (t + 5)[c • p(t)] = c • (t + 5)p(t) 

= c-T[p(t)] 
and T is a linear transformation. 



6. a. T (p) = (2 - 1 + 1 2 ) + 1 2 (2 - 1 + 1 2 ) = 2 - 1 + 3t 2 - 1 3 + 1 4 

b. Let p and q be polynomials in P 2 , and let c be any scalar. Then 

T (p(t) + q(t)) = [p(0 + q(0] + t 2 [p{t) + q(0] 

= [p(0 + t 2 p(t )] + [q(0 + 1 2 q(0] 

= T(p(0) + r(q(0) 

T (c • p(0) = [c ■ p(0] + 1 2 [c • p(t )] 

= c-[p(0 + Lp(0] 

= c-T[p(t)] 

and T is a linear transformation. 
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c. Let B = {\,t,t 1 } and C = {1, t, t 2 , t\ t 4 } . Since TXb^rfl) = 1 + ^(1) = t l + l,|T(b 1 )] c = 


2n \ _^2 


Likewise since T(b 2 ) = T(t) =t + (t 2 ){t) = t 3 + t, |T(b 2 )] c = 


and 


since T (b 3 ) = T(t 2 ) = t 2 + (t 2 )(t 2 ) = t 4 + 1 2 , [T (b 3 )] c = 


B and C is [ [rOMk [7(b 2 )] c U(b 3 )] c ] = 


0 
0 
1 
0 
1 

1 0 0 
0 1 0 
1 0 1 
0 1 0 
0 0 1 


. Thus the matrix for T relative to 


7. Since r(b 1 ) = T(l) = 3 + 5L[T(b 1 )] i? = 


. Likewise since T(b 2 ) = T(t) = -2t + 4t , [7’(b 2 )] B = 


0 

-2 

4 


and since T(b 3 ) = T(t 2 ) = t 2 ,[T(b 3 )] B = 


Thus the matrix representation of T relative to the basis 


B is [[Tdb^B [T( b 2 )] B [T( b 3 )]/ = 


. Perhaps a faster way is to realize that the 


3 0 0 

5-2 0 

0 4 1 

information given provides the general form of T(p) as shown in the figure below: 
T 

2 

t U\i t 


a n + aj + a 1 t 2 >3 a 0 + (5 a 0 -2a 1 )t + (4a i +a 2 )t 2 


coordinate 

mapping 


\P 
a, n 


multiplication 


by[r] s 


4/ 

3a, 


coordinate 

mapping 


5a 0 -2aj 

4a ] +a 2 
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The matrix that implements the multiplication along the bottom of the figure is easily filled in by 
inspection: 

? ? ? a 0 3 a 0 3 0 0 

? ? ? = 5a 0 -2flj implies that |T] 5 =5-20 

? ? ? a 2 4aj+<2 2 0 4 1 

3" 

8. Since [3bj —4b 2 ] B = —4 , [T(3b[ — 4b 2 )] B =[T] 5 [3b 1 — 4b 2 ] B 

0 

and r(3b 1 -4b 2 ) = 24b 1 -20b 2 +llb 3 . 

5 + 3(— 1)1 |"2~ 

9. a. r(p)= 5 + 3(0) = 5 

5 + 3(1) J |_8 

b. Let p and q be polynomials in P 2 , and let c be any scalar. Then 

"(p + q)(— i)i r P (-i)+q(-i)i r p(-i)i rq(-i)" 

T (p + q) = (p + q)(0) = P (0) + q(0) = p(0) + q(0) =T(p) + r(q) 

_(p + q)(l)J [_ PO + qQ J L P(!) J L q(l) _ 

"(c-p)(-l)' c ■ (p(— 1)) p(-l) 

T(c- p)= (c • p)(0) = c ■ (p(0)) =c- p(0) =c-T(p) 

_(c-p)(l)J |_c-(p(l))J L P(l) _ 

and T is a linear transformation. 

c. Let B = {1, t, t 2 } and £ = {e l5 e 2 , e 3 } be the standard basis for T 3 . Since 

_i ] r — i~i it 

[r(b 1 )] f =T(b 1 ) = ni)= 1 , [T(b 2 )] £ =T(b 2 ) = m= 0 , and [r(b 3 )] f =J(b 3 ) = T(f 2 ) = 0 , 

l\ [ lj [l 

"1 -1 1 

the matrix for Trelative to B and £ is [[r(bj)] £ [T(b 2 )] f [T(b 3 )] g ]= 1 0 0 

1 1 1 



10 . 


a. Let p and q be polynomials in P 3 , and let c be any scalar. Then 


"(P + q)(-3)l r P (-3) + q(— 3)“ 
r , . (P + q)(— 1) p(-l) + q(-l) 

T(p + q) = 

(p + q)(l) p(l) + q(l) 

_ (p + q)(3) J [ p( 3 ) + q( 3 ) 


"p(-3)l I" q(— 3) 
p(-l) + q( 1) 

p(l) q(l) 

_ p(3) J L q(3) _ 


=r( P )+r(q) 


r(c-p) = 


"(c-p)(-3) 

(c-pX-1) 

(c-p)(l) 

_ ( C 'P)(3) 


c ■ (p( 3)) r p(-3) 

c-(p(-l)) p(-l) 

= c ■ =c-T{ p) 

c< P(l)) P(l) 

_c-(p(3))J |_ p(3) _ 


and T is a linear transformation. 
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b. Let B = {1, t, t 2 , Z 3 } and £ = {e, , e 2 , e 3 , e 4 } be the standard basis for 3 . Since 


[r(b 1 )],=nb 1 )=r(i) = 


T 


'-3' 


"9" 

l 


-1 

, U(b 3 )]g =T(b 3 ) = T(t 2 ) = 

1 

l 

, [T(b 2 )] £ =T(b 2 ) = T(t) = 

1 

1 

l 


3 


9 


and 


U(b 4 )] £ =r(b 4 )=r(L) = 


-27 

-1 

1 

27 


the matrix for T relative to B and £ is 


[[nbJk [r(b 2 )] £ [r(b 3 )] £ [r(b 4 )] £ ] = 


1 -3 9 -27 

1-11 -1 
111 1 

1 3 9 27 


11. Following Example 4, if P = b 3 b 2 = 


2 1 

-1 2 


then the 5-matrix is 


P~ X AP = - 


"2 

-1" 

‘ 3 

4' 

" 2 

f 


"1 

5' 

1 

2 

-1 

-1 

-1 

2 


0 

1 


12. Following Example 4, if P = [bj b 7 ] = 
1 


-1 

1 


then the 5-matrix is 


1 

f 

'-1 

4' 

“3 

-l" 


1 

2" 

-2 

3 

-2 

3_ 

2 

1 


-2 

1 


P~ x AP = - 


13. Start by diagonalizing A. The characteristic polynomial is A 2 — 4/. + 3 = (A — 1)(A — 3), so the eigenvalues 
of A are 1 and 3. 

"-i r 


For A, = 1 : A- 1 = 


-3 3 


. The equation ( 4 - Z ) x = 0 amounts to -jq +x 2 =0, so x x = x 2 with x 2 


free. A basis vector for the eigenspace is thus V[ = 


For A = 3: 4-3/ = 


-3 1 
-3 1 


. The equation (4-3/)x = 0 amounts to -3x, +x 2 =0, so x, =(l/3)x 2 with 


x 2 free. A nice basis vector for the eigenspace is thus v 2 = 


From V! and v 2 we may construct P= v, v 2 = 


1 1 
1 3 


which diagonalizes 4. By Theorem 8, the 


basis B = {vj , v 2 } has the property that the Z?-matrix of the transformation x f-> Ax is a diagonal matrix. 
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14 . Start by diagonalizing A. The characteristic polynomial is A 2 — 6a — 16 = (a — 8)(a + 2), so the 
eigenvalues of A are 8 and -2. 

'-3 -3" 


For X = 8: 5-8/ = 


-7 -7 

free. A basis vector for the eigenspace is thus v, = 


. The equation (A- 8/)x = 0 amounts to x l + x 2 - 0, so x l = -x 2 with x 2 


-1 

1 


For X = 2: A + 21 = 


7 -3 

-7 3 


. The equation ( A-2I)x = 0 amounts to lx x -3x 2 =0, so x, =(3/7 )jc 2 


with x 2 free. A nice basis vector for the eigenspace is thus v 2 = 


From V! and v 2 we may construct P = v, v 2 = 


which diagonalizes A. By Theorem 8, the 


-1 3 

1 7 . 

basis 5 = {Vj, v 2 } has the property that the 5-matrix of the transformation xf->ix is a diagonal matrix. 


15 . Start by diagonalizing A. The characteristic polynomial is X 2 -7X + lO = (X — 5)(X-2), so the 
eigenvalues of A are 5 and 2. 

'-1 -2 


For X = 5: A- 51 = 


-1 -2 


. The equation (A - 5/)x = 0 amounts to X, + 2x 2 = 0, so X, = -2x 2 with 


x 2 free. A basis vector for the eigenspace is thus v, = 


-2 

1 


For X = 2: A- 21 = 


2 -2 

-1 1 


The equation (A-2I)x = 0 amounts to x, - x 2 = 0, so x, = x 2 with x 2 


free. A basis vector for the eigenspace is thus v 2 = 
From V! and v 2 we may construct P = [vj v 2 ] = 


which diagonalizes A. By Theorem 8, the 


-2 1 

1 1 

basis B = {vj , v 2 } has the property that the 5-matrix of the transformation xf->dx is a diagonal matrix. 


16 . Start by diagonalizing A. The characteristic polynomial is X“ — 5X = X(X — 5), so the eigenvalues of A are 
5 and 0. 

"-3 - 6 " 


For X = 5: A-5I = 


-1 -2 

x 2 free. A basis vector for the eigenspace is thus v, = 


The equation (A-5I)x = 0 amounts to x, +2x 2 = 0, so x, =-2x 2 with 


-2 

1 


For X = 0: A-0I = 


2 -6 
-1 3 


. The equation (A - 0/)x = 0 amounts to x, - 3x 2 = 0, so x, = 3x 2 with 


x 2 free. A basis vector for the eigenspace is thus v 2 = 
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which diagonalizes A. By Theorem 8, the 


-2 3 

1 1 

basis 5 = {Vj, v 2 } has the property that the 5-matrix of the transformation x I— > Ax is a diagonal matrix. 


From V! and v 2 we may construct P = v, v 2 = 


17. a. We compute that 
Ab t = 


1 

f 

T 


'2' 

-1 

3_ 

l 


2 


= 2bj 


so b, is an eigenvector of A corresponding to the eigenvalue 2. The characteristic polynomial of A is 

'-1 f 


A" — 4 A + 4 = ( A — 2) , so2is the only eigenvalue for A . Now A - 21 = 


-1 1 


, which implies that 


the eigenspace corresponding to the eigenvalue 2 is one-dimensional. Thus the matrix A is not 
diagonalizable. 

b. Following Example 4, if P = [bj b , J , then the 5-matrix for T is 


P^AP = 


-4 5 

1 -1 


1 

f 

1 

f 


"1 

5' 



3_ 

-1 

3_ 


1 

4_ 



2 -1 

0 2 


18. If there is a basis 5 such that [7’] /; is diagonal, then A is similar to a diagonal matrix, by the second 
paragraph following Example 3. In this case, A would have three linearly independent eigenvectors. 
However, this is not necessarily the case, because A has only two distinct eigenvalues. 

19. If A is similar to 5, then there exists an invertible matrix P such that P { AP = 5. Thus 5 is invertible 
because it is the product of invertible matrices. By a theorem about inverses of products, 

5 _1 =5“ 1 5“ 1 (5' 1 )“ 1 =P~ l A~ l P, which shows that A~ l is similar to B~\ 

20. If A = PBP~ l , then A 2 = {PBP~ X ){PBP^) = PB(P~ X P)BF _1 = PB ■ I ■ BP~' =PB 2 P~\ So A 2 is 
similar to 5 2 . 

21. By hypothesis, there exist invertible P and Q such that P 1 BP = A and Q X CQ = A. Then 

P~ l BP = Q l CQ. Left-multiply by Q and right-multiply by Q~ l to obtain QP l BPQ l =QQ~ 1 CQQ~ 1 . 

So C = QP l BPQ l =(PQ~ l )~ l B(PQ~ l ), which shows that 5 is similarto C. 

22. If A is diagonalizable, then A = PDP 1 for some P. Also, if 5 is similar to A, then 5 = QAQ 1 
for some Q. Then 5 = Q(PDP~ l )Q~ l = ( QP)D(P~ l Q _1 ) = ( QP)D(QP )~ 1 

So 5 is diagonalizable. 

23. If Ax = Xx,x^0, then P^ l Ax = XP~ l x. If B = P l AP, then 

5(5~ 1 x) = P~ l AP(P~ l x) = P~ l Ax = A5 _1 x (*) 

by the first calculation. Note that P ^ 0, because x ^ 0 and P 1 is invertible. Hence (*) shows that 

P~ l x is an eigenvector of 5 corresponding to A. (Of course, A is an eigenvalue of both A and 5 because 
the matrices are similar, by Theorem 4 in Section 5.2.) 

24. If A = PBP l , then rank A = rank P( BP 1 ) = rank BP 1 , by Supplementary Exercise 13 in Chapter 4. 

Also, ra nk BP 1 = rank 5, by Supplementary Exercise 14 in Chapter 4, since P 1 is invertible. Thus 
rank A = ra nk 5. 
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25. If A = PBP~\ then 

tr (A) = tr ((PB)P~ l ) = tr (PfPB)) By the trace property 

= tr (P l PB) = tr (IB) = tr (B) 

If B is diagonal, then the diagonal entries of B must be the eigenvalues of A, by the Diagonalization 
Theorem (Theorem 5 in Section 5.3). So tr A = tr B = {sum of the eigenvalues of A}. 

26 . If A = PDP 1 for some P, then the general trace property from Exercise 25 shows that 

tr A = tr [(PD)P l ] = tr [P l PD] = tr D. (Or, one can use the result of Exercise 25 that since A is similar 
to D, tr A = tr D. ) Since the eigenvalues of A are on the main diagonal of D, tr D is the sum of the 
eigenvalues of A. 

27 . For each j, /(b ; ) = b .. Since the standard coordinate vector of any vector in " is just the vector itself, 
[/(by)] f =b y . Thus the matrix for / relative to B and the standard basis £ is simply | b, b 2 ... b„ 
This matrix is precisely the change-of-coordinates matrix P B defined in Section 4.4. 

28 . For each j, /(b ; ) = b ; , and [7(b -)] c =[b ] c . By formula (4), the matrix for / relative to the bases B 
and C is 

M = [i bJc [b 2 ]c - [hJc] 

In Theorem 15 of Section 4.7, this matrix was denoted by P and was called the change-of-coordinates 

C< — B 

matrix from B to C. 

29 . If B = {b 1; ...,b„}, then the ^-coordinate vector of b . is e-, the standard basis vector for ".For 
instance, 

bj = 1 • bj +0-b 2 + — E 0 - b „ 

Thus [/(bj)]* =[bj] B = e js and 

[/]s = [[/(b I )] B •••[/(b JI )]*] = [e 1 •••e,J = / 

30. [M] If P is the matrix whose columns come from B , then the 5-matrix of the transformation x I Ax is 
D = P X AP. From the data in the text, 



'-14 

4 

- 14 ' 





'-1 

-1 


-f 



A = 

-33 

9 

-31 

,P = 

[0. 

b 2 


-2 

-1 


-2 

1 



11 

-4 

11 





1 

1 


0 




" 2 

-1 

f 


-14 

4 

- 14 ' 

'-1 

-1 

-f 


"8 

3 

-6' 

D = 

-2 

1 

0 

- 

-33 

9 

-31 

-2 

-1 

-2 

= 

0 

1 

3 


-1 

0 

-1 


11 

-4 

11 

1 

1 

0 


0 

0 

-3 
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31. [M] If P is the matrix whose columns come from B, then the 5-matrix of the transformation xh>,4x 
is D = P l AP. From the data in the text, 


A = 

"-7 

1 

-48 

14 

-16' 

6 

>M b i 

b 2 b 3 ] 

"-3 

1 

-2 

1 

3" 

-1 


-3 

-45 

-19 



-3 

-3 

0 



"-1 

-3 

-1/3" 

'-7 

-48 

-16" 

"-3 

-2 

3" 


'-7 

-2 

-6" 

D = 

1 

3 

0 

1 

14 

6 

1 

1 

-1 

= 

0 

-4 

-6 


0 

-1 

-1/3 

-3 

-45 

-19 

-3 

-3 

0 


0 

0 

-1 


32. [M] A = 


"15 -66 -44 -33 

0 13 21 -15 

1 -15 -21 12 

2 -18 -22 8 
ev= eig (A) = (2 , 4, 4, 5) 


nulbasis (A-ev (1) *eye (4 ) ) = 


0.0000 

-1.5000 

1.5000 

1.0000 

0 


A basis for the eigenspace of X = 2 is bj = 


-3 

3 

2 


nulbasis (A-ev (2 ) *eye (4 ) ) = 


"-10.0000" 


"13.0000" 

-2.3333 


1.6667 

1.0000 

9 

0 

0 


1.0000 


A basis for the eigenspace of X = 4 is {b 2 ,b 3 } = 

2.7500 
-0.7500 
1.0000 
1.0000 

11 



-30 


"39' 



-7 


5 



3 

9 

0 



0 


3 



nulbasis (A-ev (4 ) *eye (4 ) ) = 


A basis for the eigenspace of X = 5 is b 4 = | 

The basis B = {b 3 , b 2 , b 3 , b 4 } is a basis for R 4 with the property that [T] B is diagonal. 


-3 

4 

4 

4 
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Note: The Study Guide comments on Exercise 25 and tells students that the trace of any square matrix A 
equals the sum of the eigenvalues of A, counted according to multiplicities. This provides a quick check on 
the accuracy of an eigenvalue calculation. You could also refer students to the property of the determinant 
described in Exercise 19 of Section 5.2. 


5.5 SOLUTIONS 


1. A = 


1 -2 
1 3 


,A-Al = 


l- A -2 
1 3 -A 


det(Y -AY) = (1- A)(3 - A) - (-2) = A 2 - 4A + 5 


Use the quadratic formula to find the eigenvalues: A = ^ + -^0- = 2 ±i. Example 2 gives a shortcut 

for finding one eigenvector, and Example 5 shows how to write the other eigenvector with no effort. 

'-1-T -2 


For A = 2 + i: A - (2 + i)I = 


1 l-i 


. The equation ( A - A/)x = 0 gives 


(— 1 — i)x, -2x 2 = 0 
x l + (1 - i)x 2 = 0 

As in Example 2, the two equations are equivalent — each determines the same relation between jq and 
x 2 . So use the second equation to obtain x ] = -(1 - i)x 2 , with x 2 free. The general solution is 


— 1 + i 
i 


, and the vector Vj = 
For ~A = 2 - i: Let v 2 = vi = 


— 1 + i 
i 

-I-? 

i 


provides a basis for the eigenspace. 


. The remark prior to Example 5 shows that v 2 is automatically an 


eigenvector for 2 + i. In fact, calculations similar to those above would show that {v 2 } is a basis for the 
eigenspace. (In general, for a real matrix A, it can be shown that the set of complex conjugates of the 
vectors in a basis of the eigenspace for A is a basis of the eigenspace for A.) 


2 . A = 


5 -5 

1 1 


. The characteristic polynomial is A 2 - 6A + 1 0, so the eigenvalues of A are 


A= 6±V36-40 =3± - 


For A = 3 + i: J-(3 + i)/ = 


2-i -5 

1 -2-i 


. The equation (A - (3 + i)7)x = 0 amounts to 
X] + (-2 - i)x 2 = 0, so X, ~ (2 + i)x 2 with x 2 free. A basis vector for the eigenspace is thus v, = 

„ _ [2-i' 

For A = 3 - i: A basis vector for the eigenspace is v 2 = vi = 


2 + i 
1 
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1 5 , 

3. A- ^ • The characteristic polynomial is A, — 4A, + 1 3, so the eigenvalues of A are 

x= 4±>p6 =2±3 . 

2 

[-1-3/ 5 1 

For X = 2 + 3 i: A — ( 2 + 3 i)I = . The equation (A — ( 2 + 3 i)I)x = 0 amounts to 

-2 1 - 3 i 


-2x, + (1-3 i)x 2 = 0, so x 1 = — — x 2 with x 2 free. A nice basis vector for the eigenspace is thus 


For A, = 2 - 3/: A basis vector for the eigenspace is v 2 = vi = 


5 -2 2 

4 . A = i The characteristic polynomial is A, -8A + 17, so the eigenvalues of A are 


_ 8±V^4 _ 


„ l-i -2 

For X - 4 + i: A - (4 + i)I = . The equation ( A — (4 + i)I)x = 0 amounts to 

1 -1-/J 

Xj + (- 1 - i)x 2 = 0, so x, = (1 + i)x 2 with x 2 free. A basis vector for the eigenspace is thus v, = 


For X - 4 - i\ A basis vector for the eigenspace is v 2 = vi = 


0 1 2 

5 . A = ^ ^ . The characteristic polynomial is X -4A. + 8, so the eigenvalues of A are 


_ 4±n/-16 _ 


2 ±2i. 


„ -2-2 i 1 

For X = 2 + 2i\ A — ( 2 + 2 i)I = . The equation (A — ( 2 + 2i)I)x = 0 amounts to 

—8 2 — 2 i 

(-2 - 2z')xj + x 2 = 0, so x 2 = (2 + 2/)X| with x, free. A basis vector for the eigenspace is thus 


2 + 2i 


For X = 2- 2 i: A basis vector for the eigenspace is v 2 = vi = 


4 3 1 2 

6. A = ^ ^ . The characteristic polynomial is A," — 8A, + 25, so the eigenvalues of A are 

x = 8±>p6 =4±3 . 

2 
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For X = 4 + 3 i: A-(4 + 3i)I = 


-3 i 3 

-3 -3 i 


. The equation ( A - (4 + 3 i)I)x = 0 amounts to jq + ix 2 = 0, so 


x, = -/x 2 with x 2 free. A basis vector for the eigenspace is thus v, = 

_ i 

For X = 4 - 3 i: A basis vector for the eigenspace is v 2 = vi = 


—i 

1 


7. A = 


V3 -1 
1 y/3 


. From Example 6, the eigenvalues are y/3 ± i. The scale factor for the transformation 


x i-> Ax is r =| X |= -y/(\/3) 2 + 1 2 = 2. For the angle of rotation, plot the point (a, b) = (v/3, 1) in the 
xv-plane and use trigonometry: 

(p = arctan (bid) = arctan (l/v/3) = tc/6 radians. 



Note: Your students will want to know whether you permit them on an exam to omit calculations for a matrix 
a -b 


of the form 


b a 

corresponding eigenvectors, 


and simply write the eigenvalues a ± bi. A similar question may arise about the 


1 

—i 


and 


which are announced in the Practice Problem. Students may have 


trouble keeping track of the correspondence between eigenvalues and eigenvectors. 


8. A = 


v/3 3 

-3 y/3 


From Example 6, the eigenvalues are v/3 ± 3 i. The scale factor for the transformation 


x i— > Ax is r = | X | = y(\/3 ) 2 + 3 2 = 2y/3. From trigonometry, the angle of rotation (p is arctan (b/a) = 
arctan (-3/^3 ) = -n/3 radians. 


9. A = 


-y/3/2 1/2 

-1/2 -y/3/2 


. From Example 6, the eigenvalues are —y/3/2 ± (1/2)/. The scale factor for the 


transformation x Ax is r = | X \ = yj(— y/3/2) 1 + (1/2) 2 = 1 . From trigonometry, the angle of rotation (p 
is arctan (b/a) = arctan (( — 1/2)/( — s/3/ 2)) = -57t/6 radians. 
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10 . 



. From Example 6, the eigenvalues are -5 ± 5 i. The scale factor for the transformation 


x (— > Ax is r = | X, | = y(— 5) 2 + 5 ’ = 5\[2. From trigonometry, the angle of rotation (p is 
arctan(/j/a) = arctan(5/(-5)) = 371/ 4 radians. 


11 . 



.1 

.1 


. From Example 6, the eigenvalues are . 1 ± . 1 i. The scale factor for the transformation 


x i-> Ax is r = | X | = \](. 1 ) : + (. 1 ) 2 = V2/10. From trigonometry, the angle of rotation (p is arctan (b/a) = 
arctan (-.l/.l) = -ji/ 4 radians. 


12 . 



. From Example 6, the eigenvalues are 0 ± .3 i. The scale factor for the transformation 


x (— > Ax is r =| X |= Vo 2 + (.3 ) 2 = .3. From trigonometry, the angle of rotation (p is arctan (b/a) = arctan 
(- 00 ) = -ji/ 2 radians. 


13. From Exercise 1 , X, = 2 ± 7, and the eigenvector v = 


— 1 — 7 
1 


and 1m v = 


-1 

0 


take P = 


-1 -1 

1 0 


. Then compute 


corresponds to X = 2-i. Since Re v = 



C = P~ l AP = 


0 

-1 


[1 

-2" 

"-1 

-f 


' 0 

f 

"-3 

-f 


[1 

3 

1 

0 


-1 

-1 

2 

-1 



-1 

2 


Actually, Theorem 9 gives the formula for C. Note that the eigenvector v corresponds to a -hi instead 

[2 1 " 

of ci + bi. If, for instance, you use the eigenvector for 2 + 7, your C will be 


Notes: The Study Guide points out that the matrix C is described in Theorem 9 and the first column of C is 
the real part of the eigenvector corresponding to a-bi, not a + bi, as one might expect. Since students may 
forget this, they are encouraged to compute C from the formula C = P~ l AP, as in the solution above. 

The Study Guide also comments that because there are two possibilities for C in the factorization of a 
2x2 matrix as in Exercise 13, the measure of rotation of the angle associated with the transformation 
xhiix is determined only up to a change of sign. The “orientation” of the angle is determined by the change 
of variable x = Eu. See Figure 4 in the text. 


14. A = 


v = 


5 -5 
1 1 
2-7 
1 


From Exercise 2, the eigenvalues of A are X = 3 + i, and the eigenvector 


corresponds to X = 3 -i. By Theorem 9, P = [Re v 1m v] = 


2 -1 

1 0 


and 


C = P~ l AP = 


" 0 

f 

"5 

-5" 

"2 

-f 


"3 

-l 

-1 

2 

1 

1 

1 

0 


1 

3 
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15. A = 


V = 


1 5 

-2 3 

1+3/ 

2 

3-1 


. From Exercise 3, the eigenvalues of A are A = 2 ± 3/, and the eigenvector 


corresponds to A = 2 - 3/. By Theorem 9, P = [Re v 1m v] = 


1 3 

2 0 


and 


C = P AP = - 


" 0 

-3" 

1 5" 

“1 

3" 


"2 

-3" 

-2 

1 

—2 3_ 

2 

0 


3 

2 


16. A = 


v = 


5 -2 

1 3 

1 — / 

1 


From Exercise 4, the eigenvalues of A are A = 4 ± /, and the eigenvector 


corresponds to A = 4-/. By Theorem 9, P = [Rev lmv] = 


1 -1 

1 0 


and 


C = P~ l AP = 


" 0 

f 

'5 

-2" 

“1 

-1" 


"4 

-1" 

-1 

1 

1 

3 

1 

0 


1 

4 


17. A = 


. The characteristic polynomial is A 2 + 1.2A + 1, so the eigenvalues of A are A = -.6 ± .8/. 


1 -.8 
4 -2.2 

To find an eigenvector corresponding to -.6 -.8 /, we compute 
1 . 6 + . 8 / -.8 
4 -1.6 + .8/ 

The equation (A - (-.6 - ,8i)I)x = 0 amounts to 4x { + (-1.6 + .8/)jc 2 =0, so x x = ((2-/)/5)jc 2 

2-r 


A-(-.6-.8i)I = 


with x 2 free. A nice eigenvector corresponding to -.6 -.8/ is thus v = 
P = [Re v 1m v] = 


. By Theorem 9, 


"2 

-1" 

and C = P“‘AP = - 

' 0 

1 " 

"1 -.8" 

"2 

-1" 


1 

J 

ON 

J 

oo 

i 

_5 

0 

5 

-5 

1 

4 -2.2 

_5 

0 


bo 

J 

On 


18. A = 


The characteristic polynomial is A 2 - 1 ,6A + 1, so the eigenvalues of A are A = .8 ± .6/. To 


1 -1 
.4 .6 

find an eigenvector corresponding to .8 -.6/, we compute 
2 + . 6 / -1 
.4 -.2 + .6/ 


A-(.8-.6i)I = 


The equation (A-(.8 — .6i)I)x = 0 amounts to Ax ] + (-.2 + ,6/)x 2 = 0, so x, = ((1 -3i)/2)x 2 with x 2 free. 

"1-3/" 


A nice eigenvector corresponding to .8 - .6/ is thus v = 
P = [Rev lmv] = 


. By Theorem 9, 


“l 

-3“ 

and C = P- 1 AP = - 

' 0 

3" 

“ 1 

-f 

“1 

-3" 


1 

r 

00 

1 ! 

2 

0 

6 

-2 

1 

.4 

.6 

2 

0 


L-6 -8J 
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19. A = 


. The characteristic polynomial is A 9 -1.92A + 1, so the eigenvalues of A are 


1.52 -.7 

.56 .4 

A. = .96 ±.28/. To find an eigenvector corresponding to .96 -.28 /, we compute 

56 + .28/ -.7 

.56 -.56 + .28/ 


J-(.96-.28/)/ = 


The equation (N-(.96-.28/)/)x = 0 amounts to .56x! +(-.56 + .28/)x 2 =0, so x ] = ((2-/)/2)x 2 with 

"2 -f 


x 2 free. A nice eigenvector corresponding to .96 -.28/ is thus v = 


P = [Re v 1m v] = 


. By Theorem 9, 


'2 

- 1 ' 

and C = P~ l AP = - 

~ 0 

f 

"1.52 

-.7" 

"2 

-f 


'.96 

-.28" 

2 

0 

2 

-2 

2 

_ .56 

.4 

2 

0 


.28 

.96 


20. A = 


. The characteristic polynomial is A 2 — .56A + 1, so the eigenvalues of A are 


-1.64 -2.4 

1.92 2.2 

A = .28 ±.96/. To find an eigenvector corresponding to .28 -.96/, we compute 

-1.92 + .96/ -2.4 

1.92 1.92 + .96/ 


^-(.28 -.96/)/ = 


The equation (N-(.28-.96/)/)x = 0 amounts to 1.92*! +(1.92 + .96/)x 2 =0, so x, = ((-2 - i)/2)x 2 with 

'-2 -i 


x 2 free. A nice eigenvector corresponding to .28 -.96/ is thus v = 


T’ = [Rev lmv] = 


. By Theorem 9, 


'-2 

-l" 

and C = P~ l AP = - 

' 0 

r 

-1.64 

-2.4" 

'-2 

-1" 


'.28 

-.96" 

2 

0 

2 

-2 

-2 

1.92 

2.2 

2 

0 


.96 

.28 


21. The first equation in (2) is (-.3 + .6/)X] - ,6x 2 = 0. We solve this for x 2 to find that 

2 


x 2 = ((-.3 + .6 i)/.6)x l = ((-1 + 2/)/2)jfj. Letting x 1 = 2, we find that y = 

-1 + 2 / 


is an eigenvector for 


the matrix A. Since y = 
vector Vj used in Example 2 


V = 

2 

-1 + 2/ 

1 

•L 

i 

J 


-1 + 2/ 

5 

L 5 J 


-1 + 2 / 

v, the vector y is a complex multiple of the 


22. Since A(/ux) = /j(Ax) = //(Ax) = X(/jx),jUx is an eigenvector of A. 

23. (a) properties of conjugates and the fact that x 7 = x T 

(b) Ax = Ax and A is real 

(c) x T Ax is a scalar and hence may be viewed as a lxl matrix 

(d) properties of transposes 

(e) A t = A and the definition of q 


24. x T Ax = x 7 (Ax) = A • x r x because x is an eigenvector. It is easy to see that x r x is real (and positive) 

because zz is nonnegative for every complex number z. Since x T Ax is real, by Exercise 23, so is A. 
Next, write x = u + /v, where u and v are real vectors. Then 

Ax = A( u + /v) = Au + /'Ay and Ax = Au + / Av 
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The real part of Ax is Au because the entries in A, u, and v are all real. The real part of Xx is A,u because 
X and the entries in u and v are real. Since Ax and Ax are equal, their real parts are equal, too. (Apply 
the corresponding statement about complex numbers to each entry of Ax.) Thus Au = au, which shows 
that the real part of x is an eigenvector of A. 

25. Write x = Re x + /(Im x), so that Ax = A(Re x) + z'A(Im x). Since A is real, so are A(Re x) and A(Im x). 
Thus A(Re x) is the real part of Ax and A( Im x) is the imaginary part of Ax. 


26. a. If X = a-bi, then 

Ax = Xv = (a - bi)( Re v + i Im v) 

= (a Re v + b Im v) + i (a Im v - b Re v) 

Re^v Im Av 

By Exercise 25, 

A(Re v) = Re Ax = a Rev + Mmv 
A(Im v) = Im Ax = -b Re v + a Im v 

b. Let E = [Rev Imv], By (a), 


A(Re x) = P , A(Im x) = P 
b 



So 

AP = [A(Re v) A(Im v)] 



.7 1.1 2.0 1.7 

-2.0 -4.0 -8.6 -7.4 

0 -.5 -1.0 -1.0 

1.0 2.8 6.0 5.3 

ev=eig(A) = (.2 + .5i,.2-.5i,.3 + .li,.3-.li) 
For X = .2 - .5 i, an eigenvector is 
nulbasis (A-ev (2 ) *eye (4 ) ) = 

0.5000 - 0 . 5000i 

-2.0000 + O.OOOOi 

0.0000 - O.OOOOi 

1 .0000 

“.5 — .57 
-2 

so that v, = 

1 0 

1 

For X = .3 - . 17, an eigenvector is 
nulbasis (A - ev (4 )* eye (4 ) ) = 

-0.5000 - O.OOOOi 


27. [M] A = 


0.0000 + 0 . 5000i 
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-0.7500 - 0 . 2500i 
1 .0000 


so that v 2 = 


-.5 
.5 i 

-.75 -.25 i 
1 


Hence by Theorem 9, P = Re Vj Im Vj Re v., Im v 9 = 


C = 


-.5 

.2 


0 

0 


0 .3 -.1 

0 .1 .3 


.5 -.5 


-2 

0 

1 


-.5 

0 


0 -.75 - 


0" 

.5 

,25 

0 


Other choices are possible, but C must equal P l AP. 


and 


28 . 


[M] A = 


-1.4 

-2.0 

-2.0 

-2.0 

-1.3 

-.8 

-.1 

-.6 

.3 

-1.9 

-1.6 

-1.4 

2.0 

3.3 

2.3 

2.6 


ev=eig(A) = (-.4 + i,-.4-i,-.2 + .5i,-.2-.5i) 


For X = -.4 - i, an eigenvector is 
nulbasis (A-ev (2 ) *eye (4 ) ) = 
-1.0000 - l.OOOOi 

-1.0000 + l.OOOOi 

1.0000 - l.OOOOi 

1 .0000 


so that Vj 


— 1 — / 
— 1 + i 
1 — i 
1 


For X = -.2 - .5 i, an eigenvector is 
nulbasis (A-ev (4 ) *eye (4 ) ) = 
0.0000 - O.OOOOi 

-0.5000 - 0 . 5000i 

-0.5000 + 0 . 5000i 

1 .0000 


so that v 2 


0 

— 1-z 
— 1 + i 
2 
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Hence by Theorem 9, P = Re v, Im Vj Re v., Im v 9 = 


- 1-1 0 0 

-1 1 -1 -1 
1-1-1 1 
10 2 0 


and 


C = 


-.4 -10 0 

1 -.4 0 0 

0 0 -.2 -.5 

0 0 .5 -.2 


. Other choices are possible, but C must equal P l AP. 


5.6 SOLUTIONS 


1. The exercise does not specify the matrix A, but only lists the eigenvalues 3 and 1/3, and the 


corresponding eigenvectors v, = 


and v 2 = 


-1 

1 


. Also, x 0 = 


a. To find the action of A on x 0 , express x 0 in terms of v, and v 2 . That is, find c, and c 2 such that 
x 0 = c,\, +c 2 v 2 . This is certainly possible because the eigenvectors v, and v 2 are linearly 
independent (by inspection and also because they correspond to distinct eigenvalues) and hence form 
a basis for R 2 . (Two linearly independent vectors in R 2 automatically span R 2 .) The row reduction 


T -1 9 " 


1 

O 

E/i 

1 1 1 


1 

^l - 

1 

O 

l 


[ V 1 V 2 X o] = 
eigenvectors (for the eigenvalues 3 and 1/3): 


shows that x 0 =5v 1 -4v 2 . Since Vj and v 2 are 



"15' 


'-4/3' 


'49/3" 

x, = Ax 0 = 5 Ax, - 4Av 2 = 5 • 3vj - 4 • (l/3)v 2 = 

15 


4/3 

— 

41/3 


b. Each time A acts on a linear combination of and v 2 , the term is multiplied by the eigenvalue 
3 and the v 2 term is multiplied by the eigenvalue 1/3: 

x 2 = Ax, = A[ 5 ■ 3 v, - 4(1/3)v 2 ] = 5(3) 2 v, - 4(l/3) 2 v 2 

In general, x A . = 5(3) i v 1 -4(l/3) i v 2 , for/->0. 


2. The vectors v, = 


f 


' 2" 


“-3' 

0 

,v 2 = 

1 

> v 3 = 

-3 

-3 


-5 


7 


are eigenvectors of a 3x3 matrix A, corresponding to 


eigenvalues 3, 4/5, and 3/5, respectively. Also, x 0 = 


-2 

-5 

3 


. To describe the solution of the equation 


x jt+1 = Ax k {k = 1,2, ...), first write x 0 in terms of the eigenvectors. 


V 3 X 0 


]- 


1 

2 

-3 

-2" 


"l 

0 

0 

2" 

0 

1 

-3 

-5 

~ 

0 

1 

0 

1 

-3 

-5 

7 

3 


0 

0 

0 

2 


=>x 0 =2vj + v 2 +2v 3 
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Then, x, = A( 2v 1 + v 2 + 2v 3 ) = 2Av l + A\ 2 + 2 A\ 3 = 2 • 3vj + (4/5)v 2 + 2 • (3/5) v 3 . In general, 
X* = 2 • 3* Vj + (4/5)* v 2 + 2 • (3/5)* v 3 . For all k sufficiently large, 


x k ~ 2-3*Vj =2-3* 


1 

0 

-3 


3. 



, det (A - A I) = (.5 - A)(l . 1 - A) + .08 = A 2 - 1 .6 A + .63. Thi s characteristic polynomial 


factors as {A- ,9){A- .1), so the eigenvalues are .9 and .7. If v, and v 2 denote corresponding 
eigenvectors, and if x 0 = c, v , + c 2 v 2 , then 


Xi =A(c 1 y 1 + c 2 y 2 ) = c 1 Ay 1 +c 2 Ay 2 =c 1 (.9)y 1 +c 2 (.7)v 2 
and for k> 1, 

** =Ci(.9)*v 1 +c 2 (.7)*v 2 

For any choices of c, and c 2 , both the owl and wood rat populations decline overtime. 


4 . A = 


,det(A- Al) = (.5-A)(l.l-/i)-(.4)(.125) = /l 2 —1.6/1 + .6. This characteristic 


.5 .4 

-.125 1.1 

polynomial factors as (A-l)(A- .6), so the eigenvalues are 1 and .6. For the eigenvalue 1, solve 

4' 

5_ 

eigenvector for the eigenvalue .6. (The entries in v 2 are not important for the long-term behavior of the 
system.) If x 0 = qv, +c 2 v 2 , then x, = c ] Ay ] +c 2 Ay 2 = c{y x +c 2 (.6)v 2 , and for k sufficiently large, 


(A-I)x = 0: 


-.5 

.4 0“ 


“-5 

4 

0' 

125 

.1 0 


0 

0 

0 


A basis for the eigenspace is v, = 


. Let v 2 be an 


= c, 


+ C 2 (-6) v 2 


Provided that c\ ^ 0, the owl and wood rat populations each stabilize in size, and eventually the 
populations are in the ratio of 4 owls for each 5 thousand rats. If some aspect of the model were to 
change slightly, the characteristic equation would change slightly and the perturbed matrix A might not 
have 1 as an eigenvalue. If the eigenvalue becomes slightly large than 1, the two populations will grow; 
if the eigenvalue becomes slightly less than 1 , both populations will decline. 


5 . A = 


. det (A - Al) = A 2 - 1 .6 A + .5775. The quadratic formula provides the roots of the 


.4 .3 

-.325 1.2 

characteristic equation: 

md 55 

2 2 

Because one eigenvalue is larger than one, both populations grow in size. Their relative sizes are 
determined eventually by the entries in the eigenvector corresponding to 1 .05. Solve (^4 — 1 .05 /)x = 0 : 

' 6 
13 

Eventually, there will be about 6 spotted owls for every 13 (thousand) flying squirrels. 


-.65 

.3 

0“ 


'-13 

6 

0" 

-.325 

.15 

0 


0 

0 

0 


. An eigenvector is Vj = 
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.4 .31 

6. When p = .5,A= $ ^ , and det(J-/U) = X~ -1.6/1 + .63 = (A-.9)(A-.7). 

The eigenvalues of A are .9 and .7, both less than 1 in magnitude. The origin is an attractor for the 
dynamical system and each trajectory tends toward 0 . So both populations of owls and squirrels 
eventually perish. 

The calculations in Exercise 4 (as well as those in Exercises 35 and 27 in Section 5.1) show that if the 
largest eigenvalue of A is 1 , then in most cases the population vector x k will tend toward a multiple 
of the eigenvector corresponding to the eigenvalue 1. [If v, and v 2 are eigenvectors, with v, 
corresponding to A = l, and if x 0 =qv, +c 2 v 2 , then x k tends toward c ] v, , provided c, is not zero.] So 
the problem here is to determine the value of the predation parameter p such that the largest eigenvalue 
of A is 1. Compute the characteristic polynomial: 

".4-/1 .3 1 

det = (.4 - /l)(l .2- A) + 3p = £ - \ .6A+ (.48 + 3 p) 

-p 1.2 — ✓IJ 

By the quadratic formula, 



2 


The larger eigenvalue is 1 when 



In this case, .64 — 1.2/? = .16, and p = A. 

7. a. The matrix A in Exercise 1 has eigenvalues 3 and 1/3. Since 1 3 1 > 1 and 1 1/3 1 < 1, the origin is a 
saddle point. 

r-ii 

b. The direction of greatest attraction is determined by v 2 = , the eigenvector corresponding to the 

eigenvalue with absolute value less than 1 . The direction of greatest repulsion is determined by 
"ll 

Vj = , the eigenvector corresponding to the eigenvalue greater than 1 . 

c. The drawing below shows: (1) lines through the eigenvectors and the origin, (2) arrows toward the 
origin (showing attraction) on the line through v 2 and arrows away from the origin (showing 
repulsion) on the line through v l5 (3) several typical trajectories (with arrows) that show the general 
flow of points. No specific points other than v, and v 2 were computed. This type of drawing is 
about all that one can make without using a computer to plot points. 






5.6 • Solutions 


305 


Note: If you wish your class to sketch trajectories for anything except saddle points, you will need to go 
beyond the discussion in the text. The following remarks from the Study Guide are relevant. 

Sketching trajectories for a dynamical system in which the origin is an attractor or a repellor is more 
difficult than the sketch in Exercise 7. There has been no discussion of the direction in which the trajectories 
“bend” as they move toward or away from the origin. For instance, if you rotate Figure 1 of Section 5.6 
through a quarter-turn and relabel the axes so that jc, is on the horizontal axis, then the new figure 
corresponds to the matrix A with the diagonal entries .8 and .64 interchanged. In general, if A is a diagonal 
matrix, with positive diagonal entries a and d, unequal to 1, then the trajectories lie on the axes or on curves 
whose equations have the form x 2 = i'(x ] )' , where .v = (In c/)/(ln a) and r depends on the initial point x 0 . 
(See Encounters with Chaos, by Denny Gulick, New York: McGraw-Hill, 1992, pp. 147-150.) 

8 . The matrix from Exercise 2 has eigenvalues 3, 4/5, and 3/5. Since one eigenvalue is greater than 1 and 
the others are less than one in magnitude, the origin is a saddle point. The direction of greatest repulsion 
is the line through the origin and the eigenvector (1, 0, -3) for the eigenvalue 3 . The direction of greatest 
attraction is the line through the origin and the eigenvector (-3, -3, 7) for the smallest eigenvalue 3/5. 


9 . A = 


1.7 -.3 

- 1.2 .8 


,det(H-X/) = A 2 -2.5A. + l = 0 


_2.5± N /T5 2 -4(1) _2.5±VT25 _2.5±1.5_ 


2 and .5 


The origin is a saddle point because one eigenvalue is greater than 1 and the other eigenvalue is less than 
1 in magnitude. The direction of greatest repulsion is through the origin and the eigenvector v, found 


below. Solve (A-2I)x = 0 : 


-.3 -.3 0 

- 1.2 - 1.2 0 


1 1 0 
0 0 0 


so Xi = -x 2 , and x 2 is free. Take V! = 


-1 

1 


The direction of greatest attraction is through the origin and the eigenvector v 2 found below. Solve 


(A-. 5/)x = 0 : 


1.2 -.3 0 

-1.2 .3 0 


1 -.25 0 

0 0 0 


, so X, =-.25x 2 , and x 2 is free. Take v 2 = 


10. A = 


.3 .4 

-.3 1.1 


, det (A - XI) = X 2 - 1 AX + .45 = 0 


, 1.4±Vl.4 2 -4(.45) INITIO 1.4±.4 , n 

X = = = = .5 and .9 

2 2 2 

The origin is an attractor because both eigenvalues are less than 1 in magnitude. The direction of greatest 
attraction is through the origin and the eigenvector v, found below. Solve 

~2 
1 


(A-.5I)x = 0 : 



'-.2 

.4 

0 “ 


“1 

-2 

0 " 

0 : 

-.3 

.6 

0 


0 

0 

0 


, so x, =2x 2 , and x^ is free. Take v, = 


11. A = 


, det(A - XI) = A, 2 - 1 ,7k + .72 = 0 


.4 .5 

-.4 1.3 

, 1.7± Vl.7 2 -4(.72) 1.7 ± Vd)T 1.7 ±.l 0 , Q 

X = - = = = .8 and .9 

2 2 2 

The origin is an attractor because both eigenvalues are less than 1 in magnitude. The direction of greatest 
attraction is through the origin and the eigenvector v, found below. Solve 

"5" 

4 


(A-.8/)x = 0: 


'-.4 

.5 

0“ 


“1 

-1.25 

0 " 

-.4 

.5 

0 


0 

0 

0 


, so X] =1.25x 2 , and x 2 is free. Take V! = 
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12 . A = 


.5 .6 

-.3 1.4 


. det (A - U) = X 2 - 1 .91 + .88 = 0 


, 1.9±Vl.9 2 -4(.88) 1.9± v/^09 1.9±.3 q 

a = - = = = .8 and 1.1 

2 2 2 

The origin is a saddle point because one eigenvalue is greater than 1 and the other eigenvalue is less than 
1 in magnitude. The direction of greatest repulsion is through the origin and the eigenvector v, found 


below. Solve (J-l.l/)x = 0 : 


-.6 .6 0 

-.3 .3 0 


1-10 
0 0 0 


so x, =x 2 , and x 2 is free. Take V[ = 


The direction of greatest attraction is through the origin and the eigenvector v 2 found below. Solve 


(A-.8I)x = 0 : 



'-.3 

.6 

0 " 


“1 

-2 

0 " 

0: 

-.3 

.6 

0 

— 

0 

0 

0 


, so x, =2x 2 , and x 2 is free. Take v 7 = 


13 . A = 


-.4 1.5 


, det (A - XI) = X 2 - 2.3k + 1 .32 = 0 


, 2.3±^2.3 2 -4(1.32) 2.3±Vd)I 2.3±.l .. ... 

2 2 2 

The origin is a repellor because both eigenvalues are greater than 1 in magnitude. The direction of 
greatest repulsion is through the origin and the eigenvector v, found below. Solve 



“-.4 

.3 

0 " 


'1 

-.75 

0 " 


3" 

1.2/)x = 0 : 

-.4 

.3 

0 


0 

0 

0 

, so x, = .75x 2 , and x 2 is free. Take v, = 

4 


14 . A = 


1.7 .6 

-.4 .7 


. det (A - XI) = A. 2 - 2.4A, + 1 .43 = 0 

2.4 + J2.4 2 - 4(1.43) 2.4±Vd)4 2.4 + .2 ,, 

= = = = 1.1 and 1 . 


3 


2 2 2 
The origin is a repellor because both eigenvalues are greater than 1 in magnitude. The direction of 
greatest repulsion is through the origin and the eigenvector v, found below. Solve 


U-1.3/)x = 0 : 


.4 .6 0 

-.4 -.6 0 



".4 

0 

.2 


15 . A = 

.3 

.8 

.3 

. Given eigenvector v, = 


.3 

.2 

.5 



1 1.5 0 

0 0 0 


, so x, =-1.5x 2 , and x 2 is free. Take v, = 


-3 

2 


and eigenvalues .5 and .2. To find the eigenvalue for v, , 


compute 



'.4 

0 

.2 

\ 1 ' 


_ .r 


.3 

.8 

.3 

.6 

= 

.6 


.3 

.2 

.5 

.3 


.3 


= 1 • Vj Thus V| is an eigenvector for X = 1 . 


'-.1 

0 

.2 

0 " 


"1 

0 

-2 

0 " 

K 1 

<N 

II 


" 2" 

.3 

.3 

.3 

0 

~ 

0 

1 

3 

0 

, x 2 = -3x 3 . 

Set v 2 = 

-3 

.3 

.2 

0 

0 


0 

0 

0 

0 

x 3 is free 


1 


For X = .5 : 
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“.2 

0 

.2 

0“ 


“1 

0 

1 

0“ 

= -x 3 


'-1' 

.3 

.6 

.3 

0 

~ 

0 

1 

0 

0 

$ 

li 

o 

Set v 3 = 

0 

.3 

.2 

.3 

0 


0 

0 

0 

0 

x 3 is free 


1 


Given x 0 = (0, .3, .7), find weights such that x 0 = c,V| +cv 2 +c 3 v 3 . 


“.1 

2 

-1 

0“ 


“1 

0 

0 

f 

.6 

-3 

0 

.3 

~ 

0 

1 

0 

.1 

.3 

1 

1 

.7 


0 

0 

0 

.3 


x 0 =Vj + .lv 2 +.3 v 3 


Xj = A\ t + AAy 2 +.3 Ay 3 = v, + .1(.5 )v 2 + .3(.2)v 3 , and 
x /t =v 1 +.l(.5)^v 2 +.3(.2) A v 3 . As k increases, x ; . approaches v r 


16. [M] 



".90 

.01 

.09“ 


“1.0000" 

A = 

.01 

.90 

.01 

• ev = eig (A) = 

0.8900 


.09 

.09 

.90 


.8100 


. To four decimal places, 



“0.9192“ 


“91/99“ 

v x = nulbasis (A - eye (3 ) ) = 

0.1919 

. Exact : 

19/99 


1.0000 

“-n 

1 


v 2 = nulbasis (A - ev (2 )* eye (3 ) ) = 


v 3 = nulbasis (A - ev (3 )* eye (3 ) ) = 


1 

0 

-1 

0 

1 


The general solution of the dynamical system is x k = c, v, + c 2 (.89) A v 2 + c 3 (,8 1) A v 3 . 


Note: When working with stochastic matrices and starting with a probability vector (having nonnegative 
entries whose sum is 1), it helps to scale Vj to make its entries sum to 1. If Vj = (91/209, 19/209, 99/209), or 
(.435, .091, .474) to three decimal places, then the weight q above turns out to be 1. See the text’s discussion 
of Exercise 27 in Section 5.2. 


17. a. 

b. 


A = 


det 


0 

.3 

-A 

.3 


1.6 

.8 


1.6 

. 8-/1 


= A 2 


- .8 A - .48 = 0. The eigenvalues of A are given by 


A = 


,8±7(-.8) 2 -4(-.48) _.8±V2A6 _ .8 + 1.6 


= 1.2 and -.4 


The numbers of juveniles and adults are increasing because the largest eigenvalue is greater than 1 . 
The eventual growth rate of each age class is 1.2, which is 20% per year. 
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To find the eventual relative population sizes, solve (A — 1.2 I)x = 0: 


-1.2 

1.6 

0" 


"1 

-4/3 

0" 

x, = (4/3)x, 

. 1 . „ 2 . Set Yl = 

4 

.3 

-.4 

0 


0 

0 

0 

x 2 is free 

3 


Eventually, there will be about 4 juveniles for every 3 adults, 
c. [M] Suppose that the initial populations are given by x 0 = (15, 10). The Study Guide describes how to 
generate the trajectory for as many years as desired and then to plot the values for each population. 
Let x k = ( j A _, a^). Then we need to plot the sequences {j A }, {a A }, {j A + a^}, and {j A /a A }. Adjacent 
points in a sequence can be connected with a line segment. When a sequence is plotted, the resulting 
graph can be captured on the screen and printed (if done on a computer) or copied by hand onto paper 
(if working with a graphics calculator). 


18. 


a. A = 


0 

.6 

0 


0 

0 

.75 


.42 

0 

.95 


b. 


ev = eig (A) = 


0.0774 + 0.4063/ 
0.0774-0.4063/ 
1.1048 


The long-term growth rate is 1.105, about 10.5 % per year. 


v = nulbasis (A - ev (3 )* eye (3 ) 


) = 


0.3801 

0.2064 

1.0000 


For each 100 adults, there will be approximately 38 calves and 21 yearlings. 


Note: The MATLAB box in the Study Guide and the various technology appendices all give directions for 
generating the sequence of points in a trajectory of a dynamical system. Details for producing a graphical 
representation of a trajectory are also given, with several options available in MATLAB, Maple, and 
Mathematica. 


5.7 SOLUTIONS 


1. From the “eigendata” (eigenvalues and corresponding eigenvectors) given, the eigenfunctions for the 


differential equation x' = Ax are v,e 4 ' and \ 2 e 11 . The general solution of x' -Ax has the form 


2 1 


-3 

1 


4 1 , 

e +c 9 


-1 

1 


21 


The initial condition x(0) = 


-6 

1 


determines c 1 and c 2 : 


4 ( 0 ) 


+ C ? 


-3 

1 

-3 -1 -6 

1 1 1 


-1 

1 


e 2(0> = 


-6 

1 

1 0 5/2 

0 1 -3/2 


Thus c x = 5/2, c 2 = -3/2, and x(/) = — 


-3" 

4 1 

3 

"-1" 

1 

e 

2 

1 


2 I 
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2. From the eigendata given, the eigenfunctions for the differential equation x' = Ax are x { e 31 and v 2 e 
The general solution of x' = Ax has the form 


- 3 1 , 

e +c 9 


-lr 


The initial condition x(0) = 


2 

3 


determines c, and c 2 : 


c. 

~-l" 

e -3 (0) 

+ C-, 

T 

e~ l(0) 



"2" 


1 




l 



3 


"-1 

1 

2" 


"l 

0 

1/2" 


1 

1 

3 


0 

1 

5/2 


1 

-1 

- 3 , 5 

e + — 
2 

1 

Thus c, =1/2, c 2 =5/2, and x(t) = — 

1 

1 


e 


-t 


3. 



, det (A - XI) = X 1 - 1 = (k - 1)(A, + 1) = 0. Eigenvalues: 1 and -1 . 


For X= 1: 

1 3 

O' 


"1 

3 

O' 

, so jq =-3x 2 with x 2 free. Take x 2 = 1 and Vj = 

'-3' 


-1 -3 

0 


0 

0 

0 


1 


For X = -1: 

" 3 3 0" 


"1 

1 0" 

, so x, =-x 2 with x 2 free. Take x 2 =1 and v 2 = 

'-f 


-1 -1 0 


0 

o ' 
o 


1 


For the initial condition x(0) = 

[vj v 2 x(0)] = 

Thus q = -5/2, c 2 = 9/2, and x(t) = — ; 


find q and c 2 such that c, v, + c 2 v 2 = x(0) : 


'-3 -1 3" 


'1 

0 

-5/2" 

1 1 2 


0 

1 

9/2 


"-3" 

e* 


"-1" 

1 


2 

1 


Since one eigenvalue is positive and the other is negative, the origin is a saddle point of the dynamical 
system described by x' = Ax. The direction of greatest attraction is the line through v 2 and the origin. 
The direction of greatest repulsion is the line through v, and the origin. 


4 . A = 


-2 -5 

1 4 


, det(A - XI) = X -2A.-3 = (k + l)(A,-3) = 0. Eigenvalues: -1 and 3. 


For X = 3: 

1 

0 

i n 
1 

IT) 

1 

1 


"1 1 o' 

, so x, = — x 2 with x 2 free. Take x 2 =1 and v, = 

"-1" 


Li i oj 


o 

o 

o 


1 


For X = -1: 

"-1 -5 

0 " 


"1 

5 

0 " 

, so Xj =-5x 2 with x 2 free. Take x 2 =1 and v 2 = 

"-5" 


1 5 

0 


0 

0 

0 


1 
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For the initial condition x(0) = 
[vj v 2 x(0)] = 


find q and c 2 such that c, v, + c 2 \ 2 = x(0) : 


-1 -5 3 

1 1 2 


13 

Thus q =13/4,c 2 =-5/4, and x(Z) = — 


1 0 13/4 

0 1 -5/4 

-5' 
1 


~-l' 

3 1 

5 ’ 

1 

e 

4 


Since one eigenvalue is positive and the other is negative, the origin is a saddle point of the dynamical 
system described by x' = Ax. The direction of greatest attraction is the line through v 2 and the origin. 
The direction of greatest repulsion is the line through v, and the origin. 


5. A = 


7 -1 
3 3 


, det (A - XI) = X 2 -10k + 24 = (A,-4)(A,-6) = 0. Eigenvalues: 4 and 6. 


, so X] =(1/3)x 2 with x 2 free. Take x 2 =3 and Vj = 


For X = 4: 

"3 

-1 

0" 


"1 

-1/3 

0 


3 

-1 

0 


0 

0 

0 

For X = 6: 

“1 

-1 

0“ 


“1 

-1 

0" 


3 

-3 

0 


0 

0 

0 ’ 




For the initial condition x(0) = 


find C] and c 2 such that c, v, + c 2 v 2 = x(0) : 


[ v , 



“1 1 3“ 


“1 

0 

-1/2" 

3 1 2 


0 

1 

7/2 


Thus q = -1/2, c 2 = 7/2, and x(Z) = 


T 

4 1 

7 

T 

3 

e 

+ — 
2 

1 


Since both eigenvalues are positive, the origin is a repellor of the dynamical system described by 
x' = Ax. The direction of greatest repulsion is the line through v 2 and the origin. 


6. A = 


1 -2 
3 -4 


For X = -2: 


For X = -1: 


“3 

-2 

0 " 


"1 

- 2/3 

0 

3 

-2 

0 


_0 

0 0 

“2 

-2 

0 “ 


“1 

-1 

0 " 

3 

-3 

0 


0 

0 

oj ’ 


det (A -XI) = X 2 +3A. + 2 = (k + l)(k + 2) = 0. Eigenvalues: -1 and -2. 

so x l =(2/3 )x 2 with x 2 free. Take x 2 =3 and Vj = 
so x { =x 2 with x 2 free. Take x 2 =1 and v 2 = 
find c, and c 2 such that c, v, +c 2 v 2 =x(0) : 


3 

For the initial condition x(0) = 

2 

r 2 i 

[V, v 2 x(0)] = 

Thus c x = -1, c 2 = 5, and x(Z) = - 


"2 

1 

3" 


"1 0 -ll 

3 

1 

2 


1 

o 

i 


e~ 2t +5 


e * . 


Since both eigenvalues are negative, the origin is an attractor of the dynamical system described by 
x' = Ax. The direction of greatest attraction is the line through v, and the origin. 
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7. From Exercise 5, A = 


7 -1 
3 3 


, with eigenvectors Vj = 


and v 2 = 


corresponding to eigenvalues 


4 and 6 respectively. To decouple the equation x' = Ax, set P = [vj v 2 ] = 


1 1 
3 1 


and let D = 


4 0 
0 6 


so that A = PDP 1 and D = P l AP. Substituting x(t) = Py(t) into x' = Ax we have 

~r(Py) = APy) = PDP-'(Py) = PDy 
at 

Since P has constant entries, j^(P y) = P(A(y)), so that left-multiplying the equality P(-^( y)) = PDy by 
P~ l yields y' = Dy, or 


Ti'(0 


'4 

0" 

Ti(0 



0 

6 

y 2 (0. 


8. From Exercise 6, A = 


1 -2 
3 -4 


with eigenvectors v, = 


and v 2 = 


corresponding to eigenvalues 


-2 and -1 respectively. To decouple the equation x' = Ax, set P= Vj v 2 = 


2 1 
3 1 


and let 


D = 


-2 0 
0 “I 

d 


, so that A = PDP 1 and D = P l AP. Substituting x(t) = Py(t) into x' = Ax we have 


— (Py) = A(Py) = PDP~\Py) = PDy 
dt 

Since P has constant entries, jj- ( Py ) = / J (^-(y)), so that left-multiplying the equality P(-j-(y) j = PDy 
by P -1 yields y' = Dy, or 


Ti'(0 


2 

0" 

Ti(0 

y 2 (t)_ 


0 

-1_ 

.t 2 (0. 


9 . A = 


-3 2 

-1 -1 


An eigenvalue of A is -2 + i with corresponding eigenvector v = 


1 — i 
1 


. The complex 


eigenfunctions xe Xr and \e' J form a basis for the set of all complex solutions to \ = Ax. The general 
complex solution is 


1 — i 
1 




+ Cn 


l H- / 
1 


,(- 2 -?)? 


where c, and c 2 are arbitrary complex numbers. To build the general real solution, rewrite ve 1 


(- 2 + 0 ? 


as: 


ve (-2-> = 

1-t 

-It it 

e e — 

1-t 


1 


1 


[" cost 

- i cos t + i sin t 


e 9, (cost + /sint) 


cost + ism t 


-it 


cost + smt 
cost 


e 21 +i 


smt-cost 

sint 


,- 2 ? 
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The general real solution has the form 



cost + sin t 

-It , 

sint-cost 

C 1 

cost 

e +c 2 

sint 


-it 


where q and c 2 now are real numbers. The trajectories are spirals because the eigenvalues are complex. 
The spirals tend toward the origin because the real parts of the eigenvalues are negative. 


10 . A = 


3 1 

-2 1 


An eigenvalue of A is 2 + i with corresponding eigenvector v = 


1 + i 
-2 


The complex 


eigenfunctions xe' J and xe ,J form a basis for the set of all complex solutions to x' = Ax. The general 
complex solution is 


1 + i 
-2 


,(2+0/ 


+ C-, 


1 — i 
-2 


,( 2 - 0 / 


where c, and c 2 are arbitrary complex numbers. To build the general real solution, rewrite xe r+l)t as: 


xe 


,(2+0/ 


+ 

J 

2 1 it 

i 

+ 
J 

-2 _ 

II 

I 

1 

K) 

l 


e 2, (cost + tsint) 


cos t + i cos t + i sin t + i sin t 
— 2 cost — 2/ sin f 


2 / 


cost-smt 
-2 cost 


e 1 ' + i 


smt + cost 
-2sint 


2 1 


The general real solution has the form 


cost-smt 
-2 cost 


e 1 ' + c. 


smt + cost 
— 2sint 


2 / 


where c, and c 2 now are real numbers. The trajectories are spirals because the eigenvalues are complex. 
The spirals tend away from the origin because the real parts of the eigenvalues are positive. 


11 . A = 


-3 -9 

2 3 


An eigenvalue of A is 3 i with corresponding eigenvector v = 


—3 + 3 i 
2 


The complex 


eigenfunctions xe ,J and xe /J form a basis for the set of all complex solutions to x' = Ax. The general 
complex solution is 


-3 + 3 i 
2 


, 00 / 


+ C, 


—3 — 3/ 
2 


,(-3 i)t 


where c x and c 2 are arbitrary complex numbers. To build the general real solution, rewrite xe rv> ' as: 
-3 + 3f" 


xe 


mt _ 


(cos 3t + i sin 3t) 


+ l 


-3cos3t-3sin3t 
2cos3t 

The general real solution has the form 


-3sin3t + 3cos3t 
2sin3t 


-3cos3t-3sin3t 

2cos3t 


+ Cn 


-3sin3t + 3cos3t 
2sin3t 


where c, and c 2 now are real numbers. The trajectories are ellipses about the origin because the real 
parts of the eigenvalues are zero. 
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12 . A = 


-7 10 

-4 5 


. An eigenvalue of A is -1 + 2 i with corresponding eigenvector v = 


3-i 

2 


. The complex 


eigenfunctions \e ,J and \e Ll form a basis for the set of all complex solutions to x' = Ax. The general 
complex solution is 


3-i 

2 


,(-t+2 i)t 


+ C-, 


3 + i 
1 


,(-1-20# 


where c, and c 2 are arbitrary complex numbers. To build the general real solution, rewrite ye 


(-1+2 i)t 


as: 


\e 


(-1+2 i)t 


e '(cos 2? + z'sin2t) 


3 -i 
2 

3cos2t + sin2t 
2cos2t 

The general real solution has the form 


-t , • 

e + 1 


3sin2t-cos2t 

2sin2t 


3 cos 2? + sin2t 

— t 

3sin2t-cos2t 

2cos2t 

e +c 2 

2sin2t 


where c, and c 2 now are real numbers. The trajectories are spirals because the eigenvalues are complex. 
The spirals tend toward the origin because the real parts of the eigenvalues are negative. 


13 . A = 


4 -3 

6 -2 


. An eigenvalue of A is 1 + 3 i with corresponding eigenvector v = 


1 + i 
2 


. The complex 


eigenfunctions \e ,J and \e Xt form a basis for the set of all complex solutions to x' = Ax. The general 
complex solution is 


1 + i 
2 


,(1+30# 


+ C, 


1 — i 

1 


,(1-30? 


where c x and c 2 are arbitrary complex numbers. To build the general real solution, rewrite ve (l+3,) ' as: 
1 + i 


ye 


(1+30/ _ 


e' (cos3t + /sin3t) 


cos3t-sin3t 

2cos3t 


e + i 


sin3t + cos3t 
2sin3t 


The general real solution has the form 


cos3t-sin3t 

2cos3t 


e +c. 


sin3? + cos3t 
2sin3t 


where c, and c 2 now are real numbers. The trajectories are spirals because the eigenvalues are complex. 
The spirals tend away from the origin because the real parts of the eigenvalues are positive. 


14 . A = 


-2 1 

-8 2 


. An eigenvalue of A is 2 i with corresponding eigenvector v = 


1 — i 
4 


. The complex 


eigenfunctions ve /J and ve /J form a basis for the set of all complex solutions to x' = Ax. The general 
complex solution is 


1 — i 
4 


e (2<) ' + c. 


1 + / 
4 
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where c, and c 2 are arbitrary complex numbers. To build the general real solution, rewrite ve (2,|r as: 

\e (2,)t = ' (cos 2t + i sin 2t) 

cos2t + sin2tj Jsin2t-cos2t 
— + i 

4cos2t J [ 4sin2t 

The general real solution has the form 

cos2t + sin2t sin2t-cos2t 
c, +C 2 

4cos2t J [ 4sm2t 

where c, and c 2 now are real numbers. The trajectories are ellipses about the origin because the real 
parts of the eigenvalues are zero. 

'-8 -12 -6' 

15. [M] A = 2 1 2 . The eigenvalues of A are: 

7 12 5 

ev = eig (A) = 

1 . 0000 
-1 . 0000 
-2 . 0000 

nulbasis (A-ev (1) *eye (3 ) ) = 

-1 . 0000 
0.2500 

1 . 0000 

'-4 

so that v, = 1 

4 

nulbasis (A-ev (2 ) *eye (3 ) ) = 

-1.2000 
0.2000 

1 . 0000 

"-6 

so that v 2 = 1 

5 

nulbasis (A-ev (3 ) *eye ( 3 ) ) = 

-1 . 0000 
0 . 0000 

1 . 0000 

'-1 

so that v 3 = 0 

1 
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Hence the general solution is x(t) = c t 

'-4' 

1 

e' +c 2 

-6 

1 

e 1 +c 3 

"-1" 

0 


4 


5 


1 


A solution with c± = 0 is attracted to the origin while a solution with c ; 


16. [M] A = 


-6 

-11 

16 

2 

5 

-4 

-4 

-5 

10 


The eigenvalues of A are: 


ev = eig (A) = 


4 . 0000 

3 . 0000 

2 . 0000 


nulbasis (A-ev (1) *eye (3 ) ) = 
2 .3333 
-0.6667 

1 . 0000 


so that v. 


7 

-2 

3 


nulbasis (A-ev (2 ) *eye (3 ) ) = 

3 . 0000 
- 1 . 0000 

1 . 0000 


so that v 2 


3 

-1 

1 


nulbasis (A-ev (3 ) *eye (3 ) ) = 

2 . 0000 
0 . 0000 

1 . 0000 


so that v 3 = 


2 

0 

1 


Hence the general solution is x(i) = c, 

“ 7' 
-2 

4 1 . 

e +c 2 

' 3" 
-1 

3/ . 

e +c 3 

i 

(N O 

i 


3 


1 


i 


all eigenvalues are positive. All trajectories tend away from the origin. 


. The origin is a saddle point. 
= c 3 = 0 is repelled. 


The origin is a repellor, because 
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17. [M] A = 


30 64 23 

-11 -23 -9 

6 15 4 

ev = eig (A) = 

5.0000 + 2 . OOOOi 

5.0000 - 2. OOOOi 

1 . 0000 

nulbasis (A-ev (1) *eye (3 ) ) = 
7.6667 - 11 . 3333i 

3.0000 + 4 . 6667i 

1 . 0000 

"23-34/ 

-9 + 14/ 

3 


The eigenvalues of A are: 


so that Vj = 


nulbasis (A-ev (2 ) *eye ( 3 ) ) = 
7.6667 + 11 . 3333i 

-3.0000 - 4 . 6667i 

1 . 0000 

"23 + 34/' 

—9 — 14/ 

3 

nulbasis (A-ev (3 ) *eye ( 3 ) ) = 
-3 . 0000 

1 . 0000 

1 . 0000 

"-3' 


so that v 2 = 


so that v 3 = 


Hence the general complex solution is 


\(t) = c 1 

'23-34 /" 
—9 + 14/ 

e <5+2i)t +c 2 

'23 + 34/' 
—9—14/ 

e (5 - 2i), +c 3 

'-3' 

1 


3 


3 


1 


Rewriting the first eigenfunction yields 


"23-34/" 


23cos2/ + 34sin2z 


—9 + 14/ 

e 5, (cos2f + /sin2/) = 

-9 cos 2/ -14 sin 2/ 

e 5t +i 

3 


3 cos 2/ 



23 sin 2/ -34 cos 2/ 
-9 sin 2/ + 14 cos 2/ 
3 sin 2/ 
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Hence the general real solution is 

23cos2t + 34sin2t 23 sin 2t — 34 cos 2t -3 

\(t) = c, -9cos2t-14sin2t e 5 ' +c 2 -9sin2f + 14cos2t e s, +c 3 1 e 
3 cos 2 1 3sin2t 1 

where c x ,c 2 , and c 3 are real. The origin is a repellor, because the real parts of all eigenvalues are 
positive. All trajectories spiral away from the origin. 

“53 -30 -2 

18. [M] A - 90 -52 -3 . The eigenvalues of A are: 

20 -10 2 

ev = eig (A) = 

-7 . 0000 

5.0000 + l.OOOOi 

5.0000 - l.OOOOi 

nulbasis (A-ev (1) *eye (3 ) ) = 

0 .5000 

1 . 0000 
0 . 0000 

“1 

so that Vj = 2 
0 

nulbasis (A-ev (2 ) *eye (3 ) ) = 

0.6000 + 0 . 2000i 
0.9000 + 0 . 3000i 

1 . 0000 

6 + 2 i 

so that v 2 = 9 + 3 i 
10 

nulbasis (A-ev (3 ) *eye (3 ) ) = 

0.6000 - 0.20000 
0.9000 - 0 . 3000i 

1 . 0000 

“6-2 i 
so that v 3 = 9 - 3 i 
10 

Hence the general complex solution is 

1 6 + 2/ 6 — 2 i 

x(t) = c t 2 e~ 7t + c 2 9 + 3 i e (5+i), +c 3 9-3 i e <5 ~ l)t 

°J [ 1° J L 10 
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Rewriting the second eigenfunction yields 


6 + 2/ 


6cos/-2sin/ 


6sin/ + 2cos/ 

9 + 3/ 

e 5 '(cos/ + /sin/) = 

9cos/-3sin/ 

5 1 . 

e + i 

9sin/ + 3cos/ 

10 


10 cos/ 


lOsin/ 


Hence the general real solution is 



" 1 " 


6cos/-2sin/ 


6 sin / + 2 cos/ 

x(/)=q 

2 

0 

-It . 

e +c 2 

9cos/-3sin/ 
10 cos/ 

5 1 . 

e +c 3 

9 sin / + 3 cos/ 
lOsin/ 


where q, c 2 , and c 3 are real. When c 2 = c 3 = 0 the trajectories tend toward the origin, and in other cases 
the trajectories spiral away from the origin. 

19. [M] Substitute = 1/5, R 2 = 1/3, Cj = 4, and C 2 = 3 into the formula for A given in Example 1, and use 
a matrix program to find the eigenvalues and eigenvectors: 


A = 


-2 3/4 

1 -1 


-3 

2 


l» *-i =“- 5 : Vt = | „ |> ^2 =-2.5 iyj = 

r 3i 

The general solution is thus x(/) = c ] e~' 5t +c 2 e~ 2 ' 5 '. The condition x(0) = 

4~| 

that | _|| 1 | = | . By a matrix program, q = 5/2 and c 2 =— 1/2, so that 

m i r_^n 

-2.5 1 


implies 


"1 

-3" 

q 


2 

2 

C 2. 



q (/) 

= x(/) = — 

T 

-.51 1 

e 

'-3' 

_v 2 (/)_ 

2 

2 

2 

^ 2 


20. [M] Substitute R l = 1/15 ,R 2 = 1/3, Q = 4, and C 2 = 2 into the formula for A given in Example 1, and use 
a matrix program to find the eigenvalues and eigenvectors: 


' -2 

1/3“ 

, X, 1 =-l:v 1 = 

T 

, X 2 = -2.5 : v 2 = 

"-2“ 

3/2 

-3/2 


3 


3_ 


A = 


The general solution is thus \(t) = q 



T 

—t 

~-2 

q 


e +c 2 



3 


3 


e 2 ' 5t . The condition x(0) = 


implies 


that 


“1 

-2“ 

q 


“3“ 

3 

3_ 

C 2_ 


3 


. By a matrix program, q = 5/3 and c 2 = -2/3, so that 


q (/) 

= x(/) = - 

T 

-i 2 

e 

“-2“ 

_v 2 (/)_ 

3 

_3_ 

3 

3_ 


-2.5 1 


21. [M] A = 


-1 -8 
5 -5 


. Rising a matrix program we find that an eigenvalue of A is -3 + 6 i with 


corresponding eigenvector v = 


2 + 6 i 
5 


. The conjugates of these form the second 


eigenvalue-eigenvector pair. The general complex solution is 


x(0 = q 


2 + 6 i 
5 


,(-3+61)1 


+ C, 


2-6 i 
5 


,(-3-61)1 
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where c, and c 2 are arbitrary complex numbers. Rewriting the first eigenfunction and taking its real and 
imaginary parts, we have 
2 + 6 / 


xe 


(-3+6 i)t _ 


e 3/ (cos 6 1 + i sin 6t) 


2 cos 6t — 6 sin 6 1 
5 cos 6 1 


e 3 ‘ + i 


2 sin 6/ + 6 cos 6/ 
5 sin 6/ 


—it 


The general real solution has the form 


2 cos 6/- 6 sin 6 1 
5 cos 6 1 


-3 1 . 

e + C", 


2sin6/ + 6cos6/ 
5 sin 6 1 


-it 


x(t) = c l 

where c, and c 2 now are real numbers. To satisfy the initial condition x(0) = 
to get c, =3,c 2 =-l. We now have 
I = x(t) = 3 


0 

15 


we solve 


“2“ 

+ c 2 

“6“ 



“0" 

5 


0 


15 


h .(0 

v c (0. 


2cos6t-6sin6t 

5cos6t 


-it 

e - 


2 sin 6t + 6cos6t 
5sin6t 


e- 3, = 


-20 sin 6 1 
15cos6t-5sin 6 1 


—it 


22. [M] J = 


0 2 
-.4 -.8 


. Using a matrix program we find that an eigenvalue of A is -.4 + .8/ with 


corresponding eigenvector v = 


- 1 - 2 / 

1 

eigenvector pair. The general complex solution is 


The conjugates of these form the second eigenvalue- 


x(0 = U 


- 1 - 2 / 

1 


„(-.4+.8i)« 


+ C, 


-1 + 2 / 
1 


,(-.4-.8i)< 


where c, and c 2 are arbitrary complex numbers. Rewriting the first eigenfunction and taking its real and 
imaginary parts, we have 
"—1 — 2 /" 


xe 


,(-.4+.8i')t . 


1 


e ' 4/ (cos. 8/ + zsin.8/) 


-cos. 8/ + 2sin.8/ 
cos. 8/ 


-At . ■ 

e + 1 


-sin.8/-2cos.8/ 
sin. 8/ 


—At 


The general real solution has the form 


-cos. 8/ + 2sin.8/ 
cos. 8/ 


e At + c-. 


-sin.8/-2cos.8/ 
sin. 8/ 


-At 


x(/)=q 

where c, and c 2 now are real numbers. To satisfy the initial condition x(0) = 

to get q = 12,c 2 = -6. We now have 


0 

12 


, we solve 


"-1" 


"-2" 


' 0" 


+ c 2 


= 


1 


0 


12 


hit) 

v c (0 


= x{t) = 12 


-cos. 8/ + 2sin.8/ 
cos. 8/ 


-At c 

e - 6 


-sin.8/-2cos.8/ 
sin. 8/ 


e Ar = 


30sin.8/ 

12cos.8/-6sin.8/ 


—At 
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5.8 SOLUTIONS 


1. The vectors in the given sequence approach an eigenvector v, . The last vector in the sequence, 
x 4 = , is probably the best estimate for v, . To compute an estimate for A, , examine 


. This vector is approximately A,V|. From the first entry in this vector, an estimate 


Ax, = 


4.9978 

1.6652 


of \ is 4.9978. 

2. The vectors in the given sequence approach an eigenvector v, . The last vector in the sequence, 


-.2520 


, is probably the best estimate for v,. To compute an estimate for A, , examine 


-1.2536 

Ax 4 = 

5.0064 
of is 5.0064. 


. This vector is approximately From the second entry in this vector, an estimate 


3. The vectors in the given sequence approach an eigenvector v, . The last vector in the sequence, 
“.51881 

x 4 = , is probably the best estimate for Vj. To compute an estimate for A, , examine 


. This vector is approximately XjVj. From the second entry in this vector, an estimate of 


Ax, = 


\ is .9075. 


4. The vectors in the given sequence approach an eigenvector v, . The last vector in the sequence, 
x 4 = , is probably the best estimate for v, . To compute an estimate for A, , examine 


. This vector is approximately XjVj. From the first entry in this vector, an estimate of T, 


Ax, = 


-.4012 


-.3009 


is -.4012. 


5 24991 1 [ 24991“ -.7999“ 

5. Since A x= is an estimate for an eigenvector, the vector v = = is 

— 3 124lJ 31241 |_-3124lJ [_ 1 

a vector with a 1 in its second entry that is close to an eigenvector of A. To estimate the dominant 

, f 4.0015] 

eigenvalue Aj of A, compute Ax = . From the second entry in this vector, an estimate of Aj 


-5.0020 


is -5.0020. 


5 -2045 1 -2045 -.4996 

6. Since A x= is an estimate for an eigenvector, the vector v = = is 

_ 4093] 4093 1_ 4093] [_ 1 

a vector with a 1 in its second entry that is close to an eigenvector of A. To estimate the dominant 

„ [-2.0008] 

eigenvalue Aj of A, compute Ax = ^ qq24 ^ rom sccor| 4 entry in this vector, an estimate of Aj 


is 4.0024. 
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7. [M] A = 


6 7 
8 5 



The data in the table below was calculated using Mathematica, which carried 


more digits than shown here. 


k 

0 1 2 3 4 5 

X A 


"l" 

0 


-.75" 

1 


1 

.9565 


".9932" 

1 


1 

.9990 


".99981 

1 J 

Ax k 


1 1 

00 On 

i i 


'11.5' 

11.0 


12.6957 

12.7826 


12.9592 

12.9456 


12.9927 

12.9948 


12.99901 

12.9987J 

Mk 

8 11.5 12.7826 12.9592 12.9948 12.9990 


The actual eigenvalue is 13. 


8. [M] A = 


2 1 
4 5 


. The data in the table below was calculated using Mathematica, which carried 


more digits than shown here. 


k 

0 1 2 3 4 5 

X A 


"l" 

0 


-.5" 

1 


".2857" 

1 


".2558" 

1 


.2510" 

1 


".2502" 

1 


Ax k 


"2" 

4 


"2" 
1 _ 


1.5714" 

6.1429 


"1.5116" 

6.0233 


1.5019" 

6.0039 


"1.5003" 

6.0006 


tk 

4 7 6.1429 6.0233 6.0039 6.0006 


The actual eigenvalue is 6. 



"8 

0 

12" 


T 

9. [M] A = 

1 

-2 

1 

> x o = 

0 


0 

3 

0 


0 


The data in the table below was calculated using Mathematica, which 


carried more digits than shown here. 


k 

0 1 2 3 4 5 6 

X A- 


"f 

0 

0 


1 

.125 

0 


1 

.0938 

.0469 


1 

.1004 

.0328 


1 

.0991 

.0359 


1 

.0994 

.0353 


1 

.0993 

.0354 


Ax k 


"8" 

1 

0 


8" 

.75 

.375 


"8.5625" 

.8594 

.2812 


"8.3942" 

.8321 

.3011 


"8.4304" 

.8376 

.2974 


"8.4233" 

.8366 

.2981 


"8.4246" 

.8368 

.2979 


Mk 

8 8 8.5625 8.3942 8.4304 8.4233 8.4246 


Thus fa =8.4233 and jd b =8.4246. The actual eigenvalue is (7 + V97)/2, or 8.42443 to five decimal 
places. 
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"1 

2 

-2 


"f 

10. [M] A = 

1 

1 

9 

> x o = 

0 


0 

1 

9 


0 


The data in the table below was calculated using Mathematica, which 


carried more digits than shown here. 


k 

0 1 2 3 4 5 6 



"l" 

0 

0 


T 

l 

0 


1 

.6667 

.3333 


'.3571' 

1 

.7857 


".0932" 

1 

.9576 


'.0183" 

1 

.9904 


'.0038" 

1 

.9982 


Ax k 


"l" 

1 

0 


“3“ 

2 

1 


1.6667 

4.6667 

3.6667 


" .7857' 
8.4286 
8.0714 


' .1780" 
9.7119 
9.6186 


" .0375" 
9.9319 
9.9136 


" .0075" 
9.9872 
9.9834 


tk 

1 3 4.6667 8.4286 9.7119 9.9319 9.9872 


Thus /J 5 =9.9319 and /il 6 =9.9872. The actual eigenvalue is 10. 


11. [M] A = 


5 

2 



The data in the table below was calculated using Mathematica, which carried 


more digits than shown here. 


k 

0 1 2 3 4 



"f 

0 


T 

.4 


1 

.4828 


1 

.4971 


1 

.4995 


Ax k 


"5" 

2 


"5.8" 

2.8 


"5.9655" 

2.9655 


"5.9942" 

2.9942 


"5.9990" 

2.9990 


ft 

5 5.8 5.9655 5.9942 5.9990 

R(* k ) 

5 5.9655 5.9990 5.99997 5.9999993 


The actual eigenvalue is 6. The bottom two columns of the table show that R(x k ) estimates the 
eigenvalue more accurately than /u k . 


12. [M] A = 


-3 

2 



The data in the table below was calculated using Mathematica, 


which carried more digits than shown here. 


k 

0 1 2 3 4 



"f 

0 

-1 

.6667 _ 

1 

-.4615 

-1 

.5098 

1 

-,4976_ 


Ax k 


"-3" 

2 

" 4.3333] 
|_ -2.0000] 

'-3.9231' 

2.0000 

" 4.0196] 

L-2.0000j 

— 3.995 1 
2.0000 



-3 -4.3333 -3.9231 -4.0196 -3.9951 

R(* k ) 

-3 -3.9231 -3.9951 -3.9997 -3.99998 
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The actual eigenvalue is -4. The bottom two columns of the table show that R(x k ) estimates the 
eigenvalue more accurately than fl k . 

13 . If the eigenvalues close to 4 and -4 have different absolute values, then one of these is a strictly 
dominant eigenvalue, so the power method will work. But the power method depends on powers of the 
quotients A 2 /A { and X i /X ] going to zero. If | A 2 /A, | is close to 1, its powers will go to zero slowly, and 
the power method will converge slowly. 

14 . If the eigenvalues close to 4 and -4 have the same absolute value, then neither of these is a strictly 
dominant eigenvalue, so the power method will not work. However, the inverse power method may still 
be used. If the initial estimate is chosen near the eigenvalue close to 4, then the inverse power method 
should produce a sequence that estimates the eigenvalue close to 4. 

15 . Suppose Ax = Xx, with x^O. For any a,Ax-aIx = (X-a)x. If a is not an eigenvalue of A, then 
A — cd is invertible and X - a is not 0; hence 

x = (A-aI)~ l (K-a)x and (A, - a)~ x x = (A - al)~ l x 

This last equation shows that x is an eigenvector of (A - af)~ l corresponding to the eigenvalue 
(k-a)~\ 


16 . Suppose that /u is an eigenvalue of (A - al) 1 with corresponding eigenvector x. Since 
(A-aiy^x = jux, 

x = ( A-aI)(jUx ) = A(jux)-(al)(jux) = ju(Ax)-a/Jx 
Solving this equation for Ax, we find that 

m ( o 

Ax= — (ajux + x)= a + — x 

VM) l MJ 

Thus A = a + (1 Iju) is an eigenvalue of A with corresponding eigenvector x. 



Thus an estimate for the eigenvalue to four decimal places is 3.3212. The actual eigenvalue is 
(25->/337)/2, or 3.3212201 to seven decimal places. 
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"8 

0 

12" 


T 

18 . [M] A = 

1 

-2 

1 

> x o = 

0 


0 

3 

0 


0 


,a = —1.4. The data in the table below was calculated using 
Mathematica, which carried more digits than shown here. 


k 

0 12 3 4 



“ 1 " 

0 

0 


1 

.3646 

-.7813 


1 

.3734 

-.7854 


1 

.3729 

-.7854 


1 

.3729 

-.7854 


y k 


40“ 

14.5833 

-31.25 


" -38.125 
-14.2361 
29.9479 


—41.1 134 
-15.3300 
32.2888 


-40.9243 

-15.2608 

32.1407 


— 40.9358 
— 1 5.2650 
32.1497 


u k 

40 -38.125 -41.1134 -40.9243 -40.9358 

v k 

-1.375 -1.42623 -1.42432 -1.42444 -1.42443 


Thus an estimate for the eigenvalue to four decimal places is -1.4244. The actual eigenvalue is 
(7 — s/97)/2, or -1.424429 to six decimal places. 



“10 

7 

8 

7" 


T 

19 . [M] A = 

7 

5 

6 

5 

> x o = 

0 

8 

6 

10 

9 

0 


7 

5 

9 

10 


0 


(a) The data in the table below was calculated using Mathematica, which carried more digits than 
shown here. 


k 

0 12 3 



“l" 

0 

0 

0 


“1“ 

.7 

.8 

_.7_ 


“.988679“ 

.709434 

1 

.932075 


“.961467“ 

.691491 

1 

.942201 


Ax k 


“10“ 

7 

8 

_ 7_ 


26.2“ 

18.8 

26.5 

24.7_ 


“29.3774“ 

21.1283 

30.5547 

_28.7887_ 


“29.0505“ 

20.8987 

30.3205 

_28.6097_ 


M k 

10 26.5 30.5547 30.3205 
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k 

4 5 6 7 



“.958115“ 

.689261 

1 

.943578 


".957691" 

.688978 

1 

.943755 


".957637“ 

.688942 

1 

.943778 


".957630" 

.688938 

1 

.943781 


Ax k 


“29.0110“ 

20.8710 

30.2927 

28.5889 


“29.0060“ 

20.8675 

30.2892 

28.5863 


“29.0054“ 

20.8671 

30.2887 

28.5859 


“29.0053" 

20.8670 

30.2887 

28.5859 


A 

30.2927 30.2892 30.2887 30.2887 


Thus an estimate for the eigenvalue to four decimal places is 30.2887. The actual eigenvalue is 


30.2886853 to seven decimal places. An estimate for the corresponding eigenvector is 


.957630 

.688938 

1 

.943781 


(b) The data in the table below was calculated using Mathematica, which carried more digits than 
shown here. 


k 

0 12 3 4 



"l" 

0 

0 

0 


“-.609756“ 

1 

-.243902 

.146341 


"-.604007“ 

1 

-.251051 

.148899 


“-.603973“ 

1 

-.251134 
.148953 _ 


“-.603972“ 

1 

-.251135 

.148953 


y k 


' 25' 
-41 
10 
-6 


“-59.5610“ 

98.6098 

-24.7561 

14.6829 


“-59.5041“ 

98.5211 

-24.7420 

14.6750 


“-59.5044“ 

98.5217 

-24.7423 

14.6751 


“-59.5044“ 

98.5217 

-24.7423 

14.6751 


tk 

-41 98.6098 98.5211 98.5217 98.5217 

V k 

-.0243902 .0101410 .0101501 .0101500 .0101500 


Thus an estimate for the eigenvalue to five decimal places is .01015. The actual eigenvalue is 


.01015005 to eight decimal places. An estimate for the corresponding eigenvector is 


-.603972 

1 

-.251135 

.148953 
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1 

2 

3 

2“ 


"l“ 

20 . [M] A = 

2 

12 

3 

13 

0 

11 

> x o = 

0 

0 

-2 

2 


_ 4 

5 

7 

2 


0 


(a) The data in the table below was calculated using Mathematica, which carried more digits than 
shown here. 


k 

0 12 3 4 

x k 


"l" 

0 

0 

0 


1 1 


“.159091“ 

1 

.272727 

.181818 


“.187023" 

1 

.170483 

.442748 


.184166“ 

1 

.180439 

.402197 


Ax k 


f 

2 

-2 

4 


1 .75 
11 
3 
2 


“3.34091“ 

17.8636 

3.04545 

7.90909 


“3.58397" 

19.4606 

3.51145 

_7.82697_ 


“3.52988“ 

19.1382 

3.43606 

7.80413 


M k 

4 11 17.8636 19.4606 19.1382 


k 

5 

6 

7 

8 

9 



.184441“ 


“.184414“ 


“.184417" 


.184416“ 


.184416“ 




1 


1 


1 


1 


1 


X k 


.179539 


.179622 


.179615 


.179615 


.179615 




_.407778 


.407021 


.407121 


.407108 


.407110 




“3.53861“ 


“3.53732“ 


“3.53750“ 


“3.53748“ 


“3.53748“ 




19.1884 


19.1811 


19.1822 


19.1820 


19.1811 


Ax. 












K 


3.44667 


3.44521 


3.44541 


3.44538 


3.44539 




7.81010 


7.80905 


7.80921 


7.80919 


7.80919 


Ilk 

19.1884 

19.1811 

19.1822 

19.1820 

19.1820 


Thus an estimate for the eigenvalue to four decimal places is 19. 1820. The actual eigenvalue is 


19.1820368 to seven decimal places. An estimate for the corresponding eigenvector is 


.184416 

1 

.179615 

.407110 
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(b) The data in the table below was calculated using Mathematica, which carried more digits than 
shown here. 


k 

0 1 2 



"l" 

0 

0 

0 


1 

.226087 

-.921739 

.660870 


1 

.222577 

-.917970 

.660496 


y k 


115“ 

26 

-106 

76 


“ 81.7304“ 
18.1913 
-75.0261 
53.9826 


“ 81.9314“ 
18.2387 
-75.2125 
54.1143 


u k 

115 81.7304 81.9314 

v k 

.00869565 .0122353 .0122053 


Thus an estimate for the eigenvalue to four decimal places is .0122. The actual eigenvalue is 


.01220556 to eight decimal places. An estimate for the corresponding eigenvector is 


1 

.222577 
-.917970 ‘ 
.660496 


21. a. A = \ 


.8 0 
0 .2 


x = 


. Here is the sequence A k x for k = 1, ...5 : 


“.4“ 

“.32“ 

“.256“ 

“.2048“ 

“.16384“ 

.1 ’ 

.02 : 

.004 J ’ 

.0008 J ’ 

.00016 


Notice that A s x is approximately ,8( A 4 x). 

Conclusion: If the eigenvalues of A are all less than 1 in magnitude, and if x ^ 0, then A k x is 
approximately an eigenvector for large k. 


b. A = 


"1 0 
0 .8 


,x = 


Here is the sequence A k x for k = 1, ...5 : 


".5“ 

“ .5“ 

.5“ 

.5“ 

.5“ 

A] 

.32 J’ 

.256 J ’ 

.2048 J ’ 

.16384 


Notice that A k x seems to be converging to 


Conclusion: If the strictly dominant eigenvalue of A is 1, and if x has a component in the direction of 
the corresponding eigenvector, then {A k x} will converge to a multiple of that eigenvector. 

. Here is the sequence A k x for k = 1,..,5 : 


“4“ 

“32“ 

“256“ 

“2048“ 

“16384“ 

1 ’ 

_ 2_ ’ 

4 ’ 

8_ ’ 

16 


c. A = 


8 0 
0 2 


,x = 
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Notice that the distance of A k x from either eigenvector of A is increasing rapidly as k increases. 
Conclusion: If the eigenvalues of A are all greater than 1 in magnitude, and if x is not an eigenvector, 
then the distance from A k x to the nearest eigenvector will increase as k — > 


Chapter 5 SUPPLEMENTARY EXERCISES 


1. a. True. If A is invertible and if Ax = 1 • x for some nonzero x, then left-multiply by A 1 to obtain 

x = A~ l x, which may be rewritten as A x = 1 • x. Since x is nonzero, this shows 1 is an eigenvalue 
of A~\ 

b. False. If A is row equivalent to the identity matrix, then A is invertible. The matrix in Example 4 of 
Section 5.3 shows that an invertible matrix need not be diagonalizable. Also, see Exercise 31 in 
Section 5.3. 

c. True. If A contains a row or column of zeros, then A is not row equivalent to the identity matrix and 
thus is not invertible. By the Invertible Matrix Theorem (as stated in Section 5.2), 0 is an eigenvalue 
of^4. 

d. False. Consider a diagonal matrix D whose eigenvalues are 1 and 3, that is, its diagonal entries are 1 
and 3. Then D 2 is a diagonal matrix whose eigenvalues (diagonal entries) are 1 and 9. In general, 
the eigenvalues of A 2 are the squares of the eigenvalues of A. 

e. True. Suppose a nonzero vector x satisfies Ax = Ax, then 

A 2 x = A(Ax) = A(Ax) = A Ax = A 2 x 


This shows that x is also an eigenvector for A 2 

f. True. Suppose a nonzero vector x satisfies Ax - Ax, then left-multiply by A~ l to obtain 

x = A~ l (Ax ) = AA~ l x. Since A is invertible, the eigenvalue X is not zero. So A~ l x = A~ l x, which 
shows that x is also an eigenvector of A _1 . 

g. False. Zero is an eigenvalue of each singular square matrix. 

h. True. By definition, an eigenvector must be nonzero. 

i. False. Let v be an eigenvector for A. Then v and 2v are distinct eigenvectors for the same eigenvalue 
(because the eigenspace is a subspace), but v and 2v are linearly dependent. 

j. True. This follows from Theorem 4 in Section 5.2 

k. False. Let A be the 3x3 matrix in Example 3 of Section 5.3. Then A is similar to a diagonal matrix 
D. The eigenvectors of D are the columns of / 3 , but the eigenvectors of A are entirely different. 


1. False. Let A = 


. Then e. 


ami e 2 = 


are eigenvectors of A, but e[ + e 2 is not. 


(Actually, it can be shown that if two eigenvectors of A correspond to distinct eigenvalues, then their 
sum cannot be an eigenvector.) 

m. False. All the diagonal entries of an upper triangular matrix are the eigenvalues of the matrix 
(Theorem 1 in Section 5.1). A diagonal entry may be zero. 

n. True. Matrices A and A r have the same characteristic polynomial, because 

det (A r - XI) = det (A - XI) 1 = det (A - XI), by the determinant transpose property. 


o. False. Counterexample: Let A be the 5x5 identity matrix. 

p. True. For example, let A be the matrix that rotates vectors through nil radians about the origin. 
Then Ax is not a multiple of x when x is nonzero. 
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q. False. If A is a diagonal matrix with 0 on the diagonal, then the columns of A are not linearly 
independent. 

r. True. If Ax = A^x and Ax = A^x, then A [ x = A 1 x and (A l -A 2 )x = 0. If x^O, then \ must equal A 1 . 

s. False. Let A be a singular matrix that is diagonalizable. (For instance, let A be a diagonal matrix with 
0 on the diagonal.) Then, by Theorem 8 in Section 5.4, the transformation xh4x is represented by 
a diagonal matrix relative to a coordinate system determined by eigenvectors of A. 

t. True. By definition of matrix multiplication, 

A = AI = A[e 1 e 2 ••• e„] = [He[ Ae 2 ■■■ Ae „] 

If Ae j =d j e j for j = 1, then A is a diagonal matrix with diagonal entries d l ,...,d n . 

u. True. If B = PDP 1 , where D is a diagonal matrix, and if A = QBQ 1 , then 
A = Q(PDP~ l )Q~ x = (QP)D(PQ)~ l , which shows that A is diagonalizable. 

v. True. Since B is invertible, AB is similar to B(AB)B~ l , which equals BA. 

w. False. Having n linearly independent eigenvectors makes an nxn matrix diagonalizable (by the 
Diagonalization Theorem 5 in Section 5.3), but not necessarily invertible. One of the eigenvalues 
of the matrix could be zero. 

x. True. If A is diagonalizable, then by the Diagonalization Theorem, A has n linearly independent 
eigenvectors v 1; in R". By the Basis Theorem, {v!,...,v n } spans R". This means that each 
vector in R" can be written as a linear combination of v l5 ...,v„. 

2. Suppose 5x^0 and ABx = Xx for some X . Then A(Bx) = Xx. Left-multiply each side by B and obtain 
BA(Bx) = B(Xx) = X( Bx). This equation says that Bx is an eigenvector of BA, because Bx ^ 0. 

3. a. Suppose Ax = Xx, with x^O. Then (51 - A)x = 5x - Ax = 5x - Xx = (5 - X)x. The eigenvalue 

is 5-X. 

b. (51 -3A + A 2 )x = 5x-3Ax + A(Ax) = 5x-3(Xx) + X 2 x = (5-3X + X 2 )x. The eigenvalue is 
5-3X + X 2 . 

4. Assume that Ax = Ax for some nonzero vector x. The desired statement is true for m = 1, by the 
assumption about A . Suppose that for some k> 1, the statement holds when m = k. That is, suppose 
that A k x = A k x. Then A k+, x = A(A k x) = A(A k x) by the induction hypothesis. Continuing, 

A k+l x = A k Ax = A k+l x, because x is an eigenvector of A corresponding to A. Since x is nonzero, this 
equation shows that /t ,;+l is an eigenvalue of A k+] , with corresponding eigenvector x. Thus the desired 
statement is true when m = k + 1 . By the principle of induction, the statement is true for each positive 
integer m. 

5. Suppose Ax = Xx, with x ^ 0. Then 
p(A)x = (c 0 I + c l A + c 2 A 2 + ... + c n A")x 

= c 0 x + c x Ax + CtA 2 x + ...+c n A n x 
= c 0 x + c x Xx + c 2 X 2 x + . . . + c n X"x = p(X)x 
So p(X) is an eigenvalue of p(A). 
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6. a. If A = PDF' 1 , then A k =PD k P~\ and 

B = 51 - 3 A + A 2 = 5 PIP~ l - 3 PDP~ l + PD 2 P~ l 
= P(5I-3D + D 2 )P~ l 


Since D is diagonal, so is 51 - 3D + D\ Thus B is similar to a diagonal matrix, 
b. p(A) = c 0 I + c x PDP~ l + c 2 PD 2 P ~ 1 + • ■ ■ + c n PD n P~ l 

= P(c Q I + c { D + c^D 2 H 1- c n D")P~ l 

= Pp(D)P~ l 

This shows that p(A) is diagonalizable, because p(D) is a linear combination of diagonal matrices 
and hence is diagonal. In fact, because D is diagonal, it is easy to see that 
~P( 2) 0 


p(D) = 


0 p(7\ 


7. If A = PDP *, then p(A) = Pp(D)P ’, as shown in Exercise 6. If the (j,j) entry in D is X, then the 
( j, j) entry in D k is X k , and so the ( j, j) entry in p(D) is pCk). If/t is the characteristic polynomial 
of A, then p(k) = 0 for each diagonal entry of D, because these entries in D are the eigenvalues of A. 
Thus p(D) is the zero matrix. Thus p(A) = P ■ 0 • P~ l = 0. 


8. a. If X is an eigenvalue of an n x n diagonalizable matrix A, then A = PDP 1 for an invertible matrix P 
and an nxn diagonal matrix D whose diagonal entries are the eigenvalues of A. If the multiplicity of 
X is 77, then X must appear in every diagonal entry of D. That is, D = XL In this case, 

A = P(XI)P~ 1 = XPIP~ l = XPP~ l = XI. 


b. 


Since the matrix A = 


3 

0 


1 

3 


is triangular, its eigenvalues are on the diagonal. Thus 3 is an 


eigenvalue with multiplicity 2. If the 2x2 matrix A were diagonalizable, then A would be 31, by 
part (a). This is not the case, so A is not diagonalizable. 


9. If I - A were not invertible, then the equation (7 - A)x = 0. would have a nontrivial solution x. Then 
x - Ax = 0 and Ax = 1 • x, which shows that A would have 1 as an eigenvalue. This cannot happen if all 
the eigenvalues are less than 1 in magnitude. So I - A must be invertible. 


10. To show that A k tends to the zero matrix, it suffices to show that each column of A k can be made as 
close to the zero vector as desired by taking k sufficiently large. The /th column of A is A e ; , where e ; is 

the /th column of the identity matrix. Since A is diagonalizable, there is a basis for P" consisting of 
eigenvectors corresponding to eigenvalues X 1 ,...,X n . So there exist scalars c l ,...,c n , such that 

e ; = c, v, +—+c„\ n (an eigenvector decomposition of 

Then, for A; = 1,2,..., 

A k tj = q f Vj + • ■ ■ + c„ (X n f v„ (*) 

If the eigenvalues are all less than 1 in absolute value, then their Ath powers all tend to zero. So (*) 
shows that A k e . tends to the zero vector, as desired. 
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11. a. Take x in H. Then x = cu for some scalar c. So Ax = A(c u) = c(Au) = c(Au) = (cA)u, which shows 
that Ax is in H. 

b. Let x be a nonzero vector in K. Since K is one-dimensional, K must be the set of all scalar multiples 
of x. If K is invariant under A, then Ax is in K and hence Ax is a multiple of x. Thus x is an 
eigenvector of A. 


12. Let U and V be echelon forms of A and B , obtained with r and s row interchanges, respectively, and no 
scaling. Then det A = (-l)'det U and det B = (-l) s det V 


Using first the row operations that reduce A to U, we can reduce G to a matrix of the form G' = 


U Y 
0 B 


Then, using the row operations that reduce B to V, we can further reduce G' to G" = 


will be r + s row interchanges, and so det G = det 


A X 
0 B 


= (-l)' +i det 


U Y 
0 V 


U Y 

0 V . 
U 


. There 


Since 


Y 

0 V 


is 


upper triangular, its determinant equals the product of the diagonal entries, 

and since U and V are upper triangular, this product also equals (det U ) (det V ). Thus 

det G = (-l)' +i (det G)(det V) = (det 4)(dct B) 


For any scalar A , the matrix G — ’kl has the same partitioned form as G, with A — 7d and B - A/ as its 
diagonal blocks. (Here / represents various identity matrices of appropriate sizes.) Hence the result 
about det G shows that det(G -A I) = det(H - XI) ■ detfS - A/) 


13. By Exercise 12, the eigenvalues of A are the eigenvalues of the matrix [3 together with the eigenvalues 


of 


. The only eigenvalue of [3] is 3, while the eigenvalues of 


5 -2 

~ 4 3 

eigenvalues of A are 1, 3, and 7. 


5 -2 

-4 3 


are 1 and 7. Thus the 


14. By Exercise 12, the eigenvalues of A are the eigenvalues of the matrix 


1 5 

2 4 


together with the 


eigenvalues of 


-7 -4 

3 1 


. The eigenvalues of 


1 5 

2 4 


are -1 and 6, while the eigenvalues of 


-7 -4 

3 1 

multiplicity 2. 


are -5 and -1. Thus the eigenvalues of A are -1,-5, and 6, and the eigenvalue -1 has 


15. Replace A by A — k in the determinant formula from Exercise 16 in Chapter 3 Supplementary Exercises. 
det(H - A/) = ( a-b - A )" -1 [a - A + (n - 1)6] 

This determinant is zero only if a-b- A = 0 or a - A + (n - 1)6 = 0. Thus A is an eigenvalue of A if and 
only if A = a - 6 or A = a + (n - 1). From the formula for det (A - A/) above, the algebraic multiplicity is 
n — 1 for a - 6 and 1 for a + (n - 1)6. 


16. The 3 x3 matrix has eigenvalues 1-2 and l + (2)(2), that is, -1 and 5. The eigenvalues of the 5x5 
matrix are 7-3 and 7 + (4)(3), that is 4 and 19. 
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17. Note that det(^4- A/) = (a n -A )(a 22 — A) — a l2 a 2l = A 2 -(a n + a 22 )h + (a n a 22 -a l2 a 21 ) 

= A 2 - (tr A ) A + det 4, and use the quadratic formula to solve the characteristic equation: 



2 


The eigenvalues are both real if and only if the discriminant is nonnegative, that is, (tr A) 7 —4 det A > 0. 

ftrA) 2 

This inequality simplifies to (tr A) 2 >4 det A and — >det A. 

v 2 , 


18. The eigenvalues of A are 1 and .6. Use this to factor A and A k . 

-i -3~ir i oi i r 2 3 " 

2 2j|_0 ,6_|4|_-2 -1 

_"-l -3fl* 0 ] l[ 2 3" 

_ _ 2 2j[o .6* J " ^4 L — 2 -1. 

_ i r-i -3ir 2 3 

_ 4[ 2 2_|[-2-(.6)* -(.6) A 

_ l[-2 + 6(.6)* -3+3(.6) A 

~~ 4 4-4(.6) a 6-2(.6) a 

ir-2 -3i 

— ^ — cis k — ^ °° 

4 4 6 



0 ll 

19. C p = ; det(C p - A/) = 6 - 5A + A 2 = p(k) 

"0 10" 

20. C p = 0 0 1; 

24 -26 9 

det(C^ - A/) = 24 - 26A + 9A 2 -A 3 = p( A) 

21. If p is a polynomial of order 2, then a calculation such as in Exercise 19 shows that the characteristic 
polynomial of C p is p(k) = (-1 ) 2 /? ( A ) , so the result is true for n = 2. Suppose the result is true for 
n = k for some k > 2, and consider a polynomial p of degree k + 1 . Then expanding det (C p - A I) 
by cofactors down the first column, the determinant of C p - A I equals 

’-A 1 0 

(-A)det ’ | +(-\) k+ 'a 0 

Cl j Cl-2 * ’ * dj^ ^ 
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The k x k matrix shown is C -XI, where q(t) = a x + a 2 t -\ — + a k t k l +t k . By the induction assumption, 
the determinant of C q - XI is (-l) A g(X). Thus 

det(C p -XI) = (~l) A+1 a 0 + (-X)(-1)*«7(X) 

= (— l) A+1 [a 0 + X(ci{ H — + a k X k + X k )] 

So the formula holds for n = k + 1 when it holds for n = k. By the principle of induction, the formula for 
detCC^ -XI) is true for all n > 2. 

0 1 0 

22. a. C p = 0 0 1 

a 0 ^2 

b. Since X is a zero ofp, a 0 + a l X + a 2 X 2 +X 3 =0 and -a 0 - a l X-a 2 X 2 =X 3 . Thus 
1 X X 

C p X = X 2 = X 2 
X 2 —a 0 - a { X - a 2 X 2 X 3 

That is, C ( \,X,X 2 ) = X{\,X,X 2 ), which shows that (1,X,A. 2 ) is an eigenvector of C p corresponding 
to the eigenvalue X . 

23. From Exercise 22, the columns of the Vandermonde matrix V are eigenvectors of C , corresponding to 
the eigenvalues X l ,X 2 ,X 2 (the roots of the polynomial p). Since these eigenvalues are distinct, the 
eigenvectors from a linearly independent set, by Theorem 2 in Section 5.1. Thus V has linearly 
independent columns and hence is invertible, by the Invertible Matrix Theorem. Finally, since the 
columns of V are eigenvectors of C , the Diagonalization Theorem (Theorem 5 in Section 5.3) shows 

that V~ l C p V is diagonal. 

24. [M] The MATLAB command roots (p) requires as input a row vector p whose entries are the 
coefficients of a polynomial, with the highest order coefficient listed first. MATLAB constructs a 
companion matrix C p whose characteristic polynomial is p, so the roots of p are the eigenvalues of C p . 

The numerical values of the eigenvalues (roots) are found by the same QR algorithm used by the 
command eig (A) . 

25. [M] The MATLAB command [P D] = eig (A) produces a matrix P, whose condition number is 

1.6 xlO 8 , and a diagonal matrix D, whose entries are almost 2, 2, 1. However, the exact eigenvalues 
of A are 2, 2, 1, and A is not diagonalizable. 

26. [M] This matrix may cause the same sort of trouble as the matrix in Exercise 25. A matrix program that 
computes eigenvalues by an interative process may indicate that A has four distinct eigenvalues, all close 
to zero. However, the only eigenvalue is 0, with multiplicity 4, because A 4 = 0. 




Orthogonality and 
Least Squares 


6.1 SOLUTIONS 

Notes: The first half of this section is computational and is easily learned. The second half concerns the 
concepts of orthogonality and orthogonal complements, which are essential for later work. Theorem 3 is an 
important general fact, but is needed only for Supplementary Exercise 13 at the end of the chapter and in 
Section 7.4. The optional material on angles is not used later. Exercises 27-31 concern facts used later. 

andv= , u • u = (— l) 2 + 2 2 = 5 , v • u — 4(— 1) + 6(2) = 8, and — — — = — . 

6J uu 5 

6 " 

and x = -2 , w • w = 3 2 + (-1) 2 + (-5) 2 = 35 , x • w = 6(3) + (— 2)(— 1) + 3(-5) = 5, and 
3 


3 

3. Since w = -1 , w • w = 3 2 + (-1) 2 + (-5) 2 = 35 , ai 
-5 

, u • u = (— l) 2 + 2 2 — 5 and — - — u = 

uu 

and v = 4 , u • v = (-1)(4) + 2(6) = 8, y • v - 4 2 + 6 2 = 52, and 
6 

fu-v^ 2 |~4l |” 8/13" 

V v - vj V ^ 13 |_6J ~~ |_12/13_ " 

6] r 3 " 

6. Since x = -2 and w = -1 , x • w = 6(3) + (-2)(-l) + 3(-5) = 5, x • x = 6 2 + (-2) 2 + 3 2 = 49, and 
3j |_-5 

6l [ 30/49" 

-2 = -10/49 . 

3 15/49 





1. Since u = 

3 

2. Since w = -1 

-5 

x-w _ 5 _ 1 
ww 35 7 
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7. Since w = 


w 


|= Vwav = ^3 2 + (-1) 2 + (-5) 2 = a/35. 


8. Since x = 


|x||=^Tx= > /6 2 +(- 2 ) 2 + 3 2 - a /49 = 7 . 


9. A unit vector in the direction of the given vector is 


1 

“-30“ 

1 

“-30“ 


“-3/5“ 

yj(- 30) 2 +40 2 

40 

50 

40 


4/5_ 


10. A unit vector in the direction of the given vector is 
1 


V(-6) 2 +4 2 + (-3) 2 


-6“ 

1 

” V 6 l 

-6“ 


-6/V6I 

4 

4 

= 

4 /Veil 

-3 

-3 


- 3 V 6 l 


11. A unit vector in the direction of the given vector is 
1 


V(7/4) 2 + (l/2) 2 +l 2 


“ 7 / 4 “ 

1 

“ 7 / 4 “ 


7/V69 

1/2 

1/2 


2 / a /69 

a / 69/16 


1 

1 

4 / a /69 


12. A unit vector in the direction of the given vector is 


1 

“8/3“ 

1 

“8/3“ 


“4/5“ 

V(8/3) 2 + 2 2 

2 

a / 100/9 

2 


_3/5_ 


13. Since x = 

“10“ 

_-3_ 

and y = 

“- 1 " 

_-5_ 


“ 0“ 


“-4“ 

14. Since u = 

-5 

and z = 

-1 


2 


8 


x — y || 2 = [10 — (— l)] 2 + [—3 — (— 5)] 2 =125 and dist (x, y) = a/125 = 5a/5 . 


u-z || 2 = [0-(-4)] 2 +[-5-(-l)] 2 +[2-8] 2 =68 and 


dist (u. z) = a/68 = 2a/T7. 


15. Since a • b = 8 (-2) + ( — 5)( -3) = -1 A 0. a and b are not orthogonal. 

16. Since u • v = 12(2) + (3)( -3) + ( — 5)(3) = 0, u and v are orthogonal. 

17. Since u • v = 3( — 4) + 2(1) + (-5)( -2) + 0(6) = 0, u and v are orthogonal. 

18. Since y • z = (-3)(1) + 7(-8) + 4(15) + 0( — 7) = 1 ^ 0, y and z are not orthogonal. 

19. a. True. See the definition of || v ||. 

b. True. See Theorem 1(c). 

c. True. See the discussion of Figure 5. 
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d. False. Counterexample: 


1 

0 


1 

0 ■ 


e. True. See the box following Example 6. 


20. a. True. See Example 1 and Theorem 1(a). 

b. False. The absolute value sign is missing. See the box before Example 2. 

c. True. See the defintion of orthogonal complement. 

d. True. See the Pythagorean Theorem. 

e. True. See Theorem 3. 


21. Theorem 1(b): 

(u + v) • w = (u + \) T w = (u r + v r )w = u r w + v r w = u • w + v • w 
The second and third equalities used Theorems 3(b) and 2(c), respectively, from Section 2.1. 

Theorem 1(c): 

(cu) • v = (cu) r v = c(u r v) = c(u • v) 

The second and third equalities used Theorems 3(c) and 2(d), respectively, from Section 2.1. 

22. Since u • u is the sum of the squares of the entries in u, u • u > 0. The sum of squares of numbers is zero 
if and only if all the numbers are themselves zero. 

23. One computes that u • v = 2(-7) + (-5)( -4) + (-1)6 = 0, || u || 2 = u • u - 2 2 + (-5) 2 + (-1) 2 = 30, 

|| v || 2 = v- v = (-7) 2 +(-4) 2 + 6 2 =101, and ||u + v || 2 = (u + v) • (u + v) = 

(2 + (-7)) 2 + (-5 + (-4)) 2 + (-1 + 6) 2 = 131. 


24. One computes that 

|| u + v ||' = (u + v) - (u + v) = ii-ii + 2u- v + v - v =||u || 2 +2u- v+ 1| v ||~ 

and 

||u- v IP-( U_ v)-(ii- v) = ii-ii -2u - v + v- v =|| u || 2 -2u- v+ 1| v || 2 
so 

|| u + V II 2 + II u - v || 2 =|| u II 2 +2u • v+ II v II 2 + II u II 2 -2u • v+ 1| v || 2 = 2 1| u || 2 +2 1| v 


25. When v = 


the set 77 of all vectors 


that are orthogonal to v is the subspace of vectors whose 


entries satisfy ax + by = 0. If a ^ 0, then x = - (b/a)y with y a free variable, and 77 is a line through the 

-b 


origin. A natural choice for a basis for 77 in this case is 


>. If a = 0 and b * 0, then by - 0. Since 


b ^ 0, y = 0 and x is a free variable. The subspace 77 is again a line through the origin. A natural choice 

“ll 1 f \~b 

k but \ 

0 } a 


for a basis for 77 in this case is 


is still a basis for 77 since a = 0 and b ^ 0. If a = 0 


and b - 0, then 77 = R 2 since the equation Ox + Oy = 0 places no restrictions on x or v. 

26. Theorem 2 in Chapter 4 may be used to show that W is a subspace of R 3 , because W is the null space of 
the 1x3 matrix u 7 . Geometrically, W is a plane through the origin. 



338 CHAPTER 6 • Orthogonality and Least Squares 


27. If y is orthogonal to u and v, then y • u = y • v = 0, and hence by a property of the inner product, 
y-(u + v) = y- u + y- v = 0 + 0 = 0. Thus y is orthogonal to u + v. 

28. An arbitrary w in Span { u, v} has the form w = qu + c 2 v . If y is orthogonal to u and v, then 
u ■ y = v • y = 0. By Theorem 1(b) and 1(c), 

w-y = (qu + q,v)-y = q(u-y) + q,(v-y) = 0 + 0 = 0 

29. A typical vector in IT has the form w =c 1 v 1 + ... + c \ p . If x is orthogonal to each v-, then by Theorems 
1(b) and 1(c), 

w-x = (c 1 v 1 +... + c p \ p )-y = q(v, -x) + ... + c p (\ p -x) = 0 
So x is orthogonal to each w in W. 

30. a. If z is in W 1 , u is in W, and c is any scalar, then (cz) • u = c(z • u) - cO = 0. Since u is any element of 

W, cz is in W L . 

b. Let z, and z 2 be in W 1 . Then for any u in IT, (z 1 +z,)-u = z,-u + z 2 -u = 0 + 0 = 0. Thus z 1 + z, is 
in W 1 . 

c. Since 0 is orthogonal to every vector, 0 is in W 1 . Thus W is a subspace. 

31. Suppose that x is in W and W 1 . Since x is in W 1 , x is orthogonal to every vector in W, including x 
itself. So x • x = 0, which happens only when x = 0. 

32. [M] 

a. One computes that || a, ||=||a 2 1|=|| a 3 ||=||a 4 ||=1 and that a,- - a, =0 for i =+ j. 

b. Answers will vary, but it should be that || Au || = || u || and || Av || = || v ||. 

c. Answers will again vary, but the cosines should be equal. 

d. A conjecture is that multiplying by A does not change the lengths of vectors or the angles between 
vectors. 


33. [M] Answers to the calculations will vary, but will demonstrate that the mapping x I— > T(x) = v 

(for v A 0 ) is a linear transformation. To confirm this, let x and y be in P", and let c be any scalar. Then 


T(x + y) = 


(x + y) • v | f (x- v) + (y • v) | f x v 


v = v+ - — v = T(x) + r(y) 


(cx) ' V ] v _ c ( x ' v ) 


34. [M] One finds that 
“-5 f 

-1 4 [1 0 5 0 -1/3 

N - 1 0 , i? = 0 1 1 0 -4/3 

0-1 [o 0 0 1 1/3 

0 3 
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The row-column rule for computing RN produces the 3x2 zero matrix, which shows that the rows of R 
are orthogonal to the columns of N. This is expected by Theorem 3 since each row of R is in Row A and 
each column of N is in Nul A. 


6.2 SOLUTIONS 


Notes: The nonsquare matrices in Theorems 6 and 7 are needed for the QR factorizarion in Section 6.4. It is 
important to emphasize that the term orthogonal matrix applies only to certain square matrices. The 
subsection on orthogonal projections not only sets the stage for the general case in Section 6.3, it also 
provides what is needed for the orthogonal diagonalization exercises in Section 7.1, because none of the 
eigenspaces there have dimension greater than 2. For this reason, the Gram-Schmidt process (Section 6.4) is 
not really needed in Chapter 7. Exercises 13 and 14 prepare for Section 6.3. 


1. Since 


-2^ 0. the set is not orthogonal. 



L J 

1 


J 







f 


"o" 


f 


"-5" 


"o" 


~-5~ 

2. Since 

-2 


1 

= 

-2 


-2 

= 

1 


-2 


1 


2 


1 


1 


2 


1 


= 0, the set is orthogonal. 


3. Since 


= -30 ^ 0, the set is not orthogonal. 


4 . Since 


5 . Since 


3 

-2 

1 

3 



- 2" 


4" 


" 0 " 

= 

-5 


-2 

= 

0 


-3 


6 


0 

n 

r 3i 

ral 




= 0, the set is orthogonal. 


= 0, the set is orthogonal. 


6. Since 


-4 

1 

-3 


= -32 & 0, the set is not orthogonal. 


7. Since Uj-u-, =12-12 = 0, {Uj,u,} is an orthogonal set. Since the vectors are non-zero, iq and u 2 are 
linearly independent by Theorem 4. Two such vectors in R 2 automatically form a basis for 2 . So 
{ii|,u, } is an orthogonal basis for P 2 . By Theorem 5, 

X U! X U 2 1 

x = — Uj -I — = 3uj + — u 2 

Uj Uj u 2 u 2 2 
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8. Since u, • u 2 = -6 + 6 = 0, {u, ,u 2 } is an orthogonal set. Since the vectors are non-zero, u, and u 2 are 
linearly independent by Theorem 4. Two such vectors in l 2 automatically form a basis for R 2 . So 
{U[,u 2 } is an orthogonal basis for 1 2 . By Theorem 5, 

xu, xu, 3 3 

x = — u, + — = — u, + — u, 

u, u, u 2 u, 2 4 

9. Since Uj u, = u, u 3 = u 2 u 3 =0, {UpU,,^} is an orthogonal set. Since the vectors are non-zero, u,, 
u,, and u 3 are linearly independent by Theorem 4. Three such vectors in R 3 automatically form a basis 
for E 3 . So {ii| ,u 2 ,u 3 } is an orthogonal basis for R 3 . By Theorem 5, 

xu, xu, xu, 5 3 „ 

x = — u, + — + — u 3 = — u, — u, + 2u 3 

u^u, u,u 2 u 3 u 3 2 2 

10. Since u, u, = u, u 3 = u 2 u 3 =0, {UpU^u,} is an orthogonal set. Since the vectors are non-zero, u,, 
u 2 , and u 3 are linearly independent by Theorem 4. Three such vectors in R 3 automatically form a basis 
for R 3 . So {ii| ,u 2 ,u 3 } is an orthogonal basis for R 3 . By Theorem 5, 

xu, xu, xu 3 4 1 1 

X = — u, + — + — u 3 = — u, + -u 2 + -u 3 

u,u, u 2 u 2 u 3 u 3 3 3 3 


11. Let y = 


and u = 


-4 

2 


. The orthogonal projection of y onto the line through u and the origin is the 


orthogonal projection of y onto u, and this vector is 


y^ 

uu 


1 


-u ■ 


-u ■ 


2 

1 



f 


~-l~ 

12. Let y = 

-1 

and u = 

3 


The orthogonal projection of y onto the line through u and the origin is the 


orthogonal projection of y onto u, and this vector is 


- y u 2 
y = — u = --u = 

uu 5 


2/5 

-6/5 


13. The orthogonal projection of y onto u is 


„ y-u 13 

y = - — u = u = 

uu 65 


-4/5 

7/5 


The component of y orthogonal to u is 


y-y = 


14/5 

8/5 


Thus y = y + (y — y) = 


-4/5 

7/5 


+ 


14/5 

8/5 


14. The orthogonal projection of y onto u is 


- y u 2 
y = — u = -u = 

uu 5 


14/5 

2/5 
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The component of y orthogonal to u is 
"-4/5“ 


14/5 

2/5 


+ 


-4/5 

28/5 


'.28/5. 

Thus y = y + (y — y) = 

15. The distance from y to the line through u and the origin is ||y - y ||. One computes that 

y u 

y-y = y » 


uu 


"3" 

3 

"8" 


3/5" 

1 

~!o 

6 


-4/5. 


so 


| y — y ||= 7 9/25 + 16/25 = 1 is the desired distance. 


16. The distance from y to the line through u and the origin is ||y - y ||. One computes that 


y u 

y-y = y u 

uu 


so || y - y ||=V36 + 9 = 375 is the desired distance. 

I. Since u • v = 0, {u, v} is an orthogonal set. However, ||u|| 2 = u-u = l/3 and 



"1/3" 


— 1/2 

17. Let u = 

1/3 

, v = 

0 


1/3 


1/2 


|| v || = v • v = 1/2, so {u, v} is not an orthonormal set. The vectors u and v may be normalized to form 
the orthonormal set 


1 ■ 

v 1 

L 

lllul 

’ll v||J 

1 


“o' 


“ o" 

18. Let u = 

1 

, v- 

-l 


0 


0 


73/3 

73/3 

73/3 


-72/2 

0 

72/2 


. Since u • v = -1 ^ 0, {u, v} is not an orthogonal set. 


19. Let u = 


-.6 


v = 


.6 


. Since u • v = 0, { u, v } is an orthogonal set. Also, 1 1 u 1 1~ = u • u = 1 and 


v || = v • v = 1, so {u, v} is an orthonormal set. 



"—2/3" 


“1/3" 

20. Let u = 

1/3 

, v = 

2/3 


2/3 


0 


. Since u • v = 0, {u, v} is an orthogonal set. However, || u || = u • u = 1 and 


|| v || = v • v = 5/9, so {u, v} is not an orthonormal set. The vectors u and v may be normalized to form 
the orthonormal set 

1/75 
2/75 
0 


u v 


u V 


-2/3 

1/3 

2/3 
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1/ Viol r 3/ Viol r o" 

21. Let u = 3/^/20 , v = -1/ V20 , and w = -1 /a/ 2 . Since u • v = u • w = v • w = 0, {u, v, w} is an 

3/a/20 -1/V20 [ 17 ^2 

orthogonal set. Also, ||u || 2 = u-u = 1, || v || 2 = v • v = 1, and || w || 2 = w • w = 1, so {u, v, w} is an 
orthonormal set. 

1/Vl8 1/-J2 T-2/3" 

22 . Let u = 4/Vl8 , v = 0 , and w = 1/3 . Since u • v = u • w = v • w = 0, {u, v, w} is an 

1/Vl8 -1/V2 _- 2/ 3 

orthogonal set. Also, || u || 2 = u-u = 1, || v || 2 = v • v = 1, and || w || 2 = w • w = 1, so {u, v, w} is an 
orthonormal set. 

23. a. True. For example, the vectors u and y in Example 3 are linearly independent but not orthogonal. 

b. True. The formulas for the weights are given in Theorem 5. 

c. False. See the paragraph following Example 5. 

d. False. The matrix must also be square. See the paragraph before Example 7. 

e. False. See Example 4. The distance is ||y - y ||. 

24. a. True. But every orthogonal set of nonzero vectors is linearly independent. See Theorem 4. 

b. False. To be orthonormal, the vectors is S must be unit vectors as well as being orthogonal to each 
other. 

c. True. See Theorem 7(a). 

d. True. See the paragraph before Example 3. 

e. True. See the paragraph before Example 7. 

25. To prove part (b), note that 

(Lx) • (Ly) = (Ux) T (U y) = x r L r L y = x r y = x • y 

because U T U - I . If y = x in part (b), (Lx) • (Lx) = x • x, which implies part (a). Part (c) of the Theorem 
follows immediately fom part (b). 

26. A set of n nonzero orthogonal vectors must be linearly independent by Theorem 4, so if such a set spans 
W it is a basis for W. Thus W is an 77 -dimensional subspace of R", and W = R". 

27. If L has orthonormal columns, then U T U - I by Theorem 6. If L is also a square matrix, then the 
equation U T U - I implies that L is invertible by the Invertible Matrix Theorem. 

28. If L is an n x n orthogonal matrix, then I - UU~ l = UU T . Since L is the transpose of L 7 , Theorem 6 

applied to U T says that L 7 has orthogonal columns. In particular, the columns of U T are linearly 
independent and hence form a basis for R" by the Invertible Matrix Theorem. That is, the rows of L form 
a basis (an orthonormal basis) for If. 

29. Since L and V are orthogonal, each is invertible. By Theorem 6 in Section 2.2, UV is invertible and 

(i UV)~ l = V~ l U~ l = V T U T - (UV ) T , where the final equality holds by Theorem 3 in Section 2.1. Thus UV 
is an orthogonal matrix. 
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30. If U is an orthogonal matrix, its columns are orthonormal. Interchanging the columns does not change 
their orthonormality, so the new matrix - say, V - still has orthonormal columns. By Theorem 6, 

V T V = /. Since V is square, V T - V _1 by the Invertible Matrix Theorem. 

~ y-u 

31. Suppose that y = u . Replacing u by cu with c ^ 0 gives 

uu 

y-(cu) c(y-u) c 2 ( yu) y u 

(cu) = ~z (c)u = u = u = y 

(cu)-(cu) c“(u-u) c“(u-u) uu 

So y does not depend on the choice of a nonzero u in the line L used in the formula. 

32. If v r v 2 =0, then by Theorem 1(c) in Section 6.1, 

(c 1 v 1 )-(c 2 v 2 ) = c 1 [v 1 •(c 2 v 2 )] = c 1 c 2 (v 1 •v 2 ) = c 1 c 2 0 = 0 


XU 


33. Let L = Span{u}, where u is nonzero, and let T(\) = u . For any vectors x and y in R" and any 


uu 


scalars c and d , the properties of the inner product (Theorem 1) show that 
(cx + dy)-u 

T (cx + dy) = u 

uu 


cx • u + dy ■ u 
= — u 

uu 

cx • u dy ■ u 

= u + — — u 

uu uu 

= cT (x) + dT (y) 

Thus T is a linear transformation. Another approach is to view T as the composition of the following 
three linear mappings: xh->u = x-v, cn-^ b = a / \ ■ \, and b I— > by. 


34. Let L - Spanju}, where u is nonzero, and let T(x) = refl L y = 2proj L y - y . By Exercise 33, the mapping 
y proj, y is linear. Thus for any vectors y and z in R" and any scalars c and d, 

T(c y + dz)-2 proj L (cy + dz) -(cy + dz) 

= 2 (c prop y + d proj £ z) - cy - dz 
- 2c proj L y - cy + 2d proj £ z - dz 
= c(2 proj £ y -y) + d(2 proj £ z - z) 

= cT(y) + dT{z) 

Thus T is a linear transformation. 


35. [M] One can compute that A r A = 100/ 4 . Since the off-diagonal entries in A r A are zero, the columns of 
A are orthogonal. 
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36. [M] 


a. One computes that U T U = / 4 , while 


UU T = 


100 


82 

0 

-20 

8 

6 

20 

24 

0 

0 

42 

24 

0 

-20 

6 

20 

-32 

-20 

24 

58 

20 

0 

32 

0 

6 

8 

0 

20 

82 

24 

-20 

6 

0 

6 

-20 

0 

24 

18 

0 

-8 

20 

20 

6 

32 

-20 

0 

58 

0 

24 

24 

20 

0 

6 

-8 

0 

18 

-20 

0 

-32 

6 

0 

20 

24 

-20 

42 


The matrices U T U and UU T are of different sizes and look nothing like each other. 

b. Answers will vary. The vector p = UU T y is in Coif/ because p -U (U T y) . Since the columns of U 
are simply scaled versions of the columns of A, Co\U = ColA. Thus each p is in Col A. 

c. One computes that U T z = 0 . 

d. From (c), z is orthogonal to each column of A. By Exercise 29 in Section 6. 1, z must be orthogonal to 
every vector in Col A; that is, z is in (Col A) 1 . 


6.3 SOLUTIONS 

Notes: Example 1 seems to help students understand Theorem 8. Theorem 8 is needed for the Gram-Schmidt 
process (but only for a subspace that itself has an orthogonal basis). Theorems 8 and 9 are needed for the 
discussions of least squares in Sections 6.5 and 6.6. Theorem 10 is used with the QR factorization to provide a 
good numerical method for solving least squares problems, in Section 6.5. Exercises 19 and 20 lead naturally 
into consideration of the Gram-Schmidt process. 

1. The vector in Span{u 4 } is 

10 " 

-6 
-2 
2 

„ . x u 4 

Since x = qu, + c 2 u 2 + c 3 u 3 + — u 4 , the vector 

U 4 u 4 


U 4 u 4 


10 


10 


1 

o 

oo 

1 


-6 


<N 

1 

2 

1 

-2 


4 

1 

0 

1 


2 


1 

1 

K> 
i 


x-u 4 72 , 

U 4 =— u 4 =2u 4 =| 


36 


is in Span{uj,u 2 ,u 3 }. 
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2. The vector in SpanjUj } is 



is in Span{u 2 ,u 3 ,u 4 }. 


3. Since Uj • u-, = -1 + 1 + 0 = 0, [u, ,u 2 } is an orthogonal set. The orthogonal projection of y onto 
Span{u!,u 2 } is 



4. Since Uj u 2 = -12 + 12 + 0 = 0. {u,,u,} is an orthogonal set. The orthogonal projection of y onto 
Span{u!,u 2 } is 



5. Since u t • u 2 = 3 + 1 - 4 = 0, {Uj ,u 2 } is an orthogonal set. The orthogonal projection of y onto 
Span{uj,u 2 } is 



6. Since Uj • u-, = 0 - 1 + 1 = 0, [u, ,u 2 } is an orthogonal set. The orthogonal projection of y onto 
Span{uj,u 2 } is 



7. Since -u 2 =5 + 3-8 = 0, { u | , u ■, } is an orthogonal set. By the Orthogonal Decomposition Theorem, 



and y = y + z, where y is in IT and z is in W 1 . 
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8. Since Uj -u 2 = — 1 + 3-2 = 0, { u , , u 2 } is an orthogonal set. By the Orthogonal Decomposition Theorem. 

[3/2] [-5/2" 

y - ^ Ul u t + — U2 u 2 = 2U) + — u 2 - 7/2 ,z=y-y = 1/2 

U 1 u i u 2 u 2 2 

and y = y + z, where y is in IT and z is in W 1 . 

9. Since Uj u, = u, -u 3 = u 2 -u 3 =0. {Uj.UT.U3} is an orthogonal set. By the Orthogonal Decomposition 
Theorem. 


„ y-u, y u 2 y-u, „ 2 2 4 „ -1 

y = u t + u 2 + — -u 3 =2 Ul + -u 2 --u 3 = ,^-y-y- 

U, U, Ut Ut u, -u, 3 3 0 3 


and y = y + z, where y is in IT and z is in IT 1 . 

10. Since Uj u, = Uj -u 3 = u 2 -u 3 =0, {Uj.Ut.u,} is an orthogonal set. By the Orthogonal Decomposition 
Theorem, 


„ y-u, y-u, y-u, 1 14 5 2 „ 2 

y = u i + u 2 + u 3 --u,+— u 2 --u 3 = ,z-y-y- 

Uj-Uj u 2 -u 2 u 3 -u 3 3 3 3 3 2 


and y = y + z, where y is in IT and z is in IT 1 . 

11. Note that v, and v 2 are orthogonal. The Best Approximation Theorem says that y , which is the 
orthogonal projection of y onto IT = Spanjvj.v-,}, is the closest point to y in W. This vector is 


„ y-v, y-v, 1 3 -1 

y=- — Lv i+- — -v 2 = - Vl +-v 2 = 

Vj-Vj v 2 -v 2 2 2 1 


12. Note that v, and v 2 are orthogonal. The Best Approximation Theorem says that y , which is the 
orthogonal projection ofy onto IT = Spanf v, , v 2 }, is the closest point to y in IT. This vector is 


y=^ v , + ^v 2 =3v 1+ lv ; = -* 
V.-V, Vt-V, -3 


13. Note that v, and v, are orthogonal. By the Best Approximation Theorem, the closest point in 
Span{Vj, v 2 } to z is 
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14. Note that v t and v 2 are orthogonal. By the Best Approximation Theorem, the closest point in 
SpanjVj, v 2 } to z is 

f 


z 


r • v 


1 Z V 2 1 

Vj + - 


V 2 =-V!+0v 2 - 


0 

- 1/2 

-3/2 


15. The distance from the point y in 1 3 to a subspace W is defined as the distance from y to the closest point 
in W. Since the closest point in W to y is y = proj M y, the desired distance is || y - y jj. One computes that 

, and || y - y || = a/40 = 2a/To. 



3“ 


"2" 

V!> 

II 

-9 

ii 

1 

0 


-1 


6_ 


16. The distance from the point y in R 4 to a subspace W is defined as the distance from y to the closest point 
in W. Since the closest point in W to y is y = proj^y, the desired distance is || y - y ||. One computes that 

y = | „ l>y-y = l „ . and||y - y|| = 8. 


"-1" 


“4" 

-5 

ii 

1 

4 

-3 

4 

9 


4 




8/9 

-2/9 

2/9" 

"1 0" 

,uu T = 

-2/9 

5/9 

4/9 

0 1 






2/9 

4/9 

5/9 


17. a. U l U = 


b. Since U T U = I 2 , the columns of U form an orthonormal basis for W, and by Theorem 10 


proj^y = UU y = 


8/9 

-2/9 

2/9" 

"4" 


"2" 

-2/9 

5/9 

4/9 

8 

= 

4 

2/9 

4/9 

5/9 

1 


5 


18. a. £/ r £/=[l] = l,£/£/ r 


1/10 -3/10 

-3/10 9/10 


b. Since U T U - 1, {Uj} forms an orthonormal basis for W, and by Theorem 10 


• T 

1/10 -3/10" 

“7“ 


"-2" 

P ro Jivy = uu y = 



= 



-3/10 9/10 

9 


6 


19. By the Orthogonal Decomposition Theorem, u 3 is the sum of a vector in W - S pan ( u , , u 2 } and a vector 
v orthogonal to W. This exercise asks for the vector v: 


v = u 3 -proj w u 3 =u 3 


— u, + — u 
3 15 


"0" 


0" 


0" 

0 

- 

-2/5 

= 

2/5 

1 


4/5 


1/5 


Any multiple of the vector v will also be in W 1 . 
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20. By the Orthogonal Decomposition Theorem, u 4 is the sum of a vector in W - Span{uj,u 2 } and a vector 
v orthogonal to W. This exercise asks for the vector v: 



1 'j 


" 0 " 


0 " 


0 " 

( 1 


1 


1/5 


4/5 

v = u 4 - proj w u 4 =u 4 -l -iq 

u 2 

30 J 


— 

— 



0 


-2/5 


2/5 


Any multiple of the vector v will also be in W 1 . 

21. a. True. See the calculations for z 2 in Example 1 or the box after Example 6 in Section 6.1. 

b. True. See the Orthogonal Decomposition Theorem. 

c. False. See the last paragraph in the proof of Theorem 8, or see the second paragraph after the 
statement of Theorem 9. 

d. True. See the box before the Best Approximation Theorem. 

e. True. Theorem 10 applies to the column space W of U because the columns of U are linearly 
independent and hence form a basis for W. 

22. a. True. See the proof of the Orthogonal Decomposition Theorem. 

b. True. See the subsection “A Geometric Interpretation of the Orthogonal Projection.” 

c. True. The orthgonal decomposition in Theorem 8 is unique. 

d. False. The Best Approximation Theorem says that the best approximation to y is proj w y. 

e. False. This statement is only true if x is in the column space of U. If n > p, then the column space of 
U will not be all of R", so the statement cannot be true for all x in R". 

23. By the Orthogonal Decomposition Theorem, each x in IT can be written uniquely as x = p + u, with p in 
Row A and u in (Row A) 1 . By Theorem 3 in Section 6.1, (Row A) 1 = Nul A, so u is in NulA. 

Next, suppose Ax = b is consistent. Let x be a solution and write x = p + u as above. Then 
Ap = A(x - u) = Ax - Au = b - 0 = b, so the equation Ax = b has at least one solution p in Row A. 

Finally, suppose that p and p, are both in RowA and both satisfy Ax = b. Then p p, is in 
NulA = (RowA) 1 , since A(p-pj) = Ap - Apj = b b = 0. The equations p = Pi +(p-Pj) and 
p = p + 0 both then decompose p as the sum of a vector in RowA and a vector in (Row A) 1 . By the 
uniqueness of the orthogonal decomposition (Theorem 8), p = Pj, and p is unique. 

24. a. By hypothesis, the vectors w, , ..., w p are pairwise orthogonal, and the vectors v, , . . ., \ q are 

pairwise orthogonal. Since w, is in W for any i and v ; is in W for any j, w, • v ; = 0 for any i and j. 
Thus {w 1 ,...,w / ,,v 1 ,...,v ? } forms an orthogonal set. 

b. For any y in R", write y = y + z as in the Orthogonal Decomposition Theorem, with y in 
W and z in W 1 . Then there exist scalars q,. . .,c p and d l ,...,d q such that y = y + z = 
qW[ + ... + C w p d-djV! + ... + d v . Thus the set {w 1 ,...,w p , Vj,..., v 9 } spans R". 

c. The set {Wj,...,w ,Vj,...,v } is linearly independent by (a) and spans R" by (b), and is thus a basis 
for R". Hence dimlT + dimlT 1 - p + q- dim R". 
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25. [M] Since U T U - I A ,U has orthonormal columns by Theorem 6 in Section 6.2. The closest point to y in 
Col U is the orthogonal projection y of y onto Col U. From Theorem 10, 


y = UU T y — 


1.2 

.4 

1.2 

1.2 

.4 

1.2 

.4 

.4 


26. [M] The distance from b to Col U is || b - 


where b = UU'b. One computes that 


b = UU l b = 


.2" 


.8" 

.92 


.08 

.44 


.56 

1 

,b-b = 

0 

-.2 

-.8 

-.44 


-.56 

.6 


-1.6 

-.92 


_-.08_ 


I b — b ||— 


VTT 2 

5 


which is 2. 1 166 to four decimal places. 


6.4 SOLUTIONS 

Notes: The QR factorization encapsulates the essential outcome of the Gram-Schmidt process, just as the LU 
factorization describes the result of a row reduction process. For practical use of linear algebra, the 
factorizations are more important than the algorithms that produce them. In fact, the Gram-Schmidt process is 
not the appropriate way to compute the QR factorization. For that reason, one should consider deemphasizing 
the hand calculation of the Gram-Schmidt process, even though it provides easy exam questions. 

The Gram-Schmidt process is used in Sections 6.7 and 6.8, in connection with various sets of orthogonal 
polynomials. The process is mentioned in Sections 7.1 and 7.4, but the one-dimensional projection 
constructed in Section 6.2 will suffice. The QR factorization is used in an optional subsection of Section 6.5, 
and it is needed in Supplementary Exercise 7 of Chapter 7 to produce the Cholesky factorization of a positive 
definite matrix. 


1. Set Vj = x, and compute that v 2 = x 2 


X 2 


▼l 


V, — x 2 -3v, = 


-1 

5 

-3 



1 


-f 


< 

0 


5 

> 


-l 


-3 





. Thus an orthogonal basis for W is 
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2. Set Vj = x, and compute that v 2 = x 2 



5 

4 1. 


-8 



" 0 " 


" 5“ 



4 

9 

4 



2 


-8 



3. Set v, = x, and compute that v 2 = x 2 



3 

3/2 

3/2 



" 2" 


3" 



-5 


3/2 



1 


3/2 



4 . Set V, = Xj and compute that v 2 = x 2 



— x 2 -(-2)v 




3" 


"3“ 



-4 


6 



5 


3 



5. Set Vj = x, and compute that v 2 = x 2 



▼i =x 2 -2vj = 


5 

1 

-4 

-1 



f 


5" 



-4 


1 



0 

9 

-4 



1 


-1 



6. Set Vj = x, and compute that v 2 = x 2 



v, = x 2 -(-3)Vj = 



‘ 3~ 


“ 4“ 



-1 


6 



2 

9 

-3 



-1 


0 



Thus an orthogonal basis for W is 


. Thus an orthogonal basis for W is 


. Thus an orthogonal basis for W is 


Thus an orthogonal basis for W is 


. Thus an orthogonal basis for W is 
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7. Since ||v 1 ||=%/30 and || v, ||= 727/2 = 376 12, an orthonormal basis for W is 

2/V30l [ 2/V61 
-5/730 , 1/76 >. 

1/730 1/76 



8. Since || v, ||= 750 and || v 2 ||= \/54 = 376, an orthonormal basis for W is 



3 / 750 1 [ l/y/6 

- 4 /yf50 , 2/76 

5/750 1/76 


9. Call the columns of the matrix x, , x 2 , and x 3 and perform the Gram-Schmidt process on these vectors: 



10. Call the columns of the matrix Xj , x 2 , and x 3 and perform the Gram-Schmidt process on these vectors: 
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11. Call the columns of the matrix x l5 x 2 , and x 3 and perform the Gram-Schmidt process on these vectors: 



12. Call the columns of the matrix Xj , x 2 , and x 3 and perform the Gram-Schmidt process on these vectors: 
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13. Since A and Q are given, 






“ 5 

9“ 




“ 5/6 

1/6 

-3/6 

1/6“ 

1 

7 


"6 

12" 

-1/6 

5/6 

1/6 

3/6 

-3 

-5 


0 

6 





1 

5_ 





14. Since A and Q are given, 






"-2 

3“ 



'-2/7 

5/7 

2/7 

4/7" 

5 

7 


"7 7" 

5/7 

2/7 

-4/7 

2/7_ 

2 

4 

-2 

6 


° 7_ 


15. The columns of Q will be normalized versions of the vectors v, , v 2 , and v 3 found in Exercise 11. Thus 



l/x/5 

1/2 

1/2 





-1/V5 

0 

0 


~J~5 

-Vs 

4^5 

<2 = 

- 1 / Vs 

1/2 

1/2 

• R — Q T A = 

0 

6 

-2 


l/x/5 

- 1/2 

1/2 


0 

0 

4 


l/x/5 

1/2 

- 1/2 





16. The columns of Q will be normalized versions of the vectors v, , v 2 , and v 3 found in Exercise 12. Thus 



1/2 

-1/2V2 

1/2 





-1/2 

1/2V2 

1/2 


"2 

8 

7" 

Q = 

0 

l/x/2 

0 

• R — Q T A = 

0 

2 V 2 

3x/2 


1/2 

1/2V2 

-1/2 


0 

0 

6 


1/2 

1/2V2 

i/2 





17. a. False. Scaling was used in Example 2, but the scale factor was nonzero. 

b. True. See (1) in the statement of Theorem 11. 

c. True. See the solution of Example 4. 

18. a. False. The three orthogonal vectors must be nonzero to be a basis for a three-dimensional subspace. 

(This was the case in Step 3 of the solution of Example 2.) 

b. True. If x is not in a subspace w, then x cannot equal proj vv x , because proj H x is in W. This idea was 
used for v A+1 in the proof of Theorem 1 1 . 

c. True. See Theorem 12. 

19. Suppose that x satisfies Rx = 0; then Q Rx = Q0 = 0, and Ax = 0. Since the columns of A are linearly 
independent, x must be 0. This fact, in turn, shows that the columns of R are linearly indepedent. Since R 
is square, it is invertible by the Invertible Matrix Theorem. 
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20. If y is in ColA, then y = Ax for some x. Then y = QRx = Q(Rx), which shows that y is a linear 

combination of the columns of Q using the entries in Rx as weights. Conversly, suppose that y = Qx for 
some x. Since R is invertible, the equation A = QR implies that Q — AR~ l . So v = AR~ l x — A(R~'x), 
which shows that y is in Col A. 


21. Denote the columns of Q by {qj,...,q„}. Note that n < m, because A is m x n and has linearly 

independent columns. The columns of Q can be extended to an orthonormal basis for R m as follows. 
Let fj be the first vector in the standard basis for R" that is not in W n — Spanfq, , . . . ,q (! } , let 
u, =fj -proj w f[, and let q )!+1 = u 1 /||u 1 1|. Then {q 1 ,...,q n ,q n+1 } is an orthonormal basis for 
W n+ j = Span{q 1 ,...,q )! ,q )!+1 }. Next let f 2 be the first vector in the standard basis for R'" that is 
not in W nH , let u 2 = f 2 -proj^fj, and let q„ +2 =u 2 /||u 2 ||. Then {q 1 ,...,q„,q (!+1 ,q )!+2 } is an 
orthogonal basis for W lt+2 - Span{ q q (i , q n+1 , q n+2 } . This process will continue until m - n vectors 
have been added to the original n vectors, and {q l5 . . .,q„,q„ +1 ,. . ,,q m } is an orthonormal basis for I m . 
Let Q 0 - [q n+1 . . . q m ] and ~[Q Q 0 \. Then, using partitioned matrix multiplication, 


a 


R 

O 


= QR = A. 


22. We may assume that {u l5 . . ,,u } is an orthonormal basis for W, by normalizing the vectors in the 
original basis given for W, if necessary. Let U be the matrix whose columns are u u . Then, by 

Theorem 10 in Section 6.3, T(x) - proj lv , x = ( JJU T )x for x in R". Thus T is a matrix transformation and 
hence is a linear transformation, as was shown in Section 1.8. 


23. Given A = QR, partition A = [A, A 2 ] , where A, has p columns. Partition Q as Q - [<2i (L] where Q x 

R\ j R l2 


has p columns, and partition R as R - 


A = [Aj A 2 ] = QR = [Q x Q 2 ] 


O R 


22 . 


O R 


12 


22 


, where R n is a p x p matrix. Then 


- [Gl^ll Q\ ^12 + Qi ^22 ] 


Thus A[ = Q\R\\- The matrix <2i has orthonormal columns because its columns come from Q. The matrix 
R t , is square and upper triangular due to its position within the upper triangular matrix R. The diagonal 
entries of R n are positive because they are diagonal entries of R. Thus Q x R n is a QR factorization of A, . 


24. [M] Call the columns of the matrix Xj , x 1 , x 3 , and x 4 and perform the Gram-Schmidt process on these 
vectors: 

▼l =*! 


V 2 = X 2 


X 2'V| 

Vi-V, 


Vi=X 2 -(-l)V! - 


3 

3 

-3 

0 

3 
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v 4 =x 4 


X 4'Vl 

VfV, 


▼l 



-V!-(-1)v 2 - 


Thus an orthogonal basis for W is 



0 

5 

0 

0 

-5 


25. [M] The columns of Q will be normalized versions of the vectors v 4 , v 2 , and v 3 found in Exercise 24. 
Thus 


Q = 


- 1/2 

1/2 

1 / V3 

0 


1/10 

1/2 

0 

1 / V2 


- 3/10 

- 1/2 

i /S 

0 


4/5 

0 


0 


1/10 

1/2 

0 

- 1 / V2 



20 

-20 

-10 

10 

0 

6 

-8 

-6 

0 

0 

6^3 

- 3^3 

0 

0 

0 

5 V 2 


26. [M] In MATLAB, when A has n columns, suitable commands are 
Q = A ( : , 1 ) / norm ( A ( : , 1 ) ) 

% The first column of Q 
for j =2 : n 

v=A ( : , j ) - Q* (Q'*A( : , j) ) 

Q ( : , j ) =v/norm (v ) 

% Add a new column to Q 
end 


6.5 SOLUTIONS 

Notes: This is a core section - the basic geometric principles in this section provide the foundation for all the 
applications in Sections 6.6-6. 8. Yet this section need not take a full day. Each example provides a stopping 
place. Theorem 13 and Example 1 are all that is needed for Section 6.6. Theorem 15, however, gives an 
illustration of why the QR factorization is important. Example 4 is related to Exercise 17 in Section 6.6. 
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1. To find the normal equations and to find x , compute 


A r A - 


-1 

2 


A r b = 


-1 

2 



a. 


The normal equations are (A r A)x = A 7 b : 


6 

-if 

■h 


“-4“ 

-11 

22 

_* 2 _ 


11 


b. Compute 


x = (A r A) _1 A 7 b = 


6 

-if 

-1 

-4 

1 

"22 

if 

“-4“ 

-11 

22 


11 

11 

11 

6 

11 


1 

"33" 


"3" 

IT 

22 


2 


2. To find the normal equations and to find x, compute 




“ 2 

f 




"2 -2 

2" 

-2 

0 



“12 

(X) 

1 0 

3 




00 

10 



2 

3 


_ 

J 




“-5“ 

1 „ . 


2 -2 

2" 



-24 

A r b = 



8 

zz 



1 0 

3 



-2 




1 




a. 


The normal equations are (A r A)x = A r b : 


“12 

8" 

■h 


"-24" 

8 

10 

_x 2 _ 


-2 


b. Compute 


x ■= (A r A) _1 A r b = 


“12 8“ 

-1 

“-24“ 

1 

“ 10 -8] 

“-24“ 

1 

OO 

o 

1 


-2 

_ 56 

(N ' 

OO 

1 

1 

-2 


1 

“224“ 


“-4“ 

56 

168 


3 


3. To find the normal equations and to find x , compute 




1 

-2 




1-10 

2“ 

-1 

2 


"6 

6“ 

-2 2 3 

5_ 

0 

3 


6 

42_ 



2 

5_ 






3“ 



“1-10 2" 

1 


6“ 

—2 2 3 5_ 

-4 


-6 


2 
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T T 6 6 x l 

a. The normal equations are (A A)x-A b: 

L 6 42 JL x 2 


b. Compute 


x = (A r A) _1 A 7 b = 


6 61 T 61 1 [42 -6l[ 6 


[6 42 J |_-6J 216 [-6 6j[_-6 

1 r 2881 _ r 4/3" 

216 -72 “ -1/3 


4. To find the normal equations and to find x , compute 

r J 1 3l r 

r 1 1 1 3 3 

A r A - 1 -1 = 

3-11 3 11 

l J i i L J 


_ 111 6 
A r b = 1 = 

3-11 14 


a. The normal equations are (A 7 A)x = A 7 b : 

b. Compute 


3 3ir.q 


3 11 he- 


T , T 33 6 111— 3 

x = (A r A) _1 A 7 b = = — 

3 11 14 24 -3 3 


i r 24 1 ri 


24 24 1 


5. To find the least squares solutions to Ax = b, compute and row reduce the augmented matrix for the 
system A T Ax = A r b : 

"4 2 2 14l [ 1 0 1 5" 

[A T A A r bJ = 2 2 0 4 ~ 0 1-1-3 

2 0 2 10 0 0 0 0 


so all vectors of the form x = -3 + x 3 1 are the least-squares solutions of Ax = b. 


6. To find the least squares solutions to Ax = b, compute and row reduce the augmented matrix for the 
system A 7 Ax = A r b : 

f6 3 3 27 1 f 1 0 1 5l 


[A T A A r b]= 3 3 0 12 ~ 0 1-1-1 
3 0 3 15 0 0 0 0 


so all vectors of the form x = -1 +x 3 1 are the least-squares solutions of Ax = b. 
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the least squares error is || Ax - b ||= V20 = 2 \[5 . 



9. (a) Because the columns aj and a 2 of A are orthogonal, the method of Example 4 may be used to find 


b , the orthogonal projection of b onto Col A: 


~ ba, ba, 2 1 

b L a t + -a 2 = -aj + -a 2 

a i a i a 2 a 2 ^ ^ 



(b) The vector x contains the weights which must be placed on a, and a 2 to produce b . These weights 


are easily read from the above equation, so x = 



10. (a) Because the columns a, and a 2 of A are orthogonal, the method of Example 4 may be used to find 
b , the orthogonal projection of b onto Col A: 

r n [2] r 4 

C b a t b a 2 ,1 . , 1 . , 

b = La i + — a 2 =3a t +— a 2 =3 — 1 h — 4 — — 1 

a, * a, a, a, 2 2 

L 1 2 L 4 

(b) The vector x contains the weights which must be placed on a, and a, to produce b . These weights 
are easily read from the above equation, so x = 
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11. (a) Because the columns a, , a 2 and a 3 of A are orthogonal, the method of Example 4 may be used to 
find b , the orthogonal projection of b onto Col A: 

ba, ba, ba, 2^1 

b = -a, + — a 2 + ^a 3 = —a, + 0a 2 + -a 3 

a, 1 a a, *a, a, "a, 3 3 



"4" 


' 0 " 


f 


“ 3" 

2 

1 

+ 0 

-5 

1 

1 


1 




+ - 


rr 


3 

6 


1 

3 

0 


4 


1 


-1 


-5_ 


-1 


(b) The vector x contains the weights which must be placed on a, , a 2 , and a 3 to produce b . These 


weights are easily read from the above equation, so 


x = 


2/3 

0 

1/3 


12. (a) Because the columns a, , a 2 and a 3 of A are orthogonal, the method of Example 4 may be used to 
find b , the orthogonal projection of b onto Col A: 


ba, 


ba. 


ba, 


^3 ^3 


a 3 — - a i + ^ a 2 + 


M 

T 



" 1 " 


r 


" 0 " 


“5" 

1 

1 

14 

0 

5 

-1 


2 

— 


+ — 


— 


= 


3 

0 

3 

1 

3 

1 


3 


-1 


1 


-1 


6 


(b) The vector x contains the weights which must be placed on a, , a 2 , and a 3 to produce b . These 


weights are easily read from the above equation, so 


x = 


1/3 

14/3 

-5/3 


13. One computes that 



if 


" 0 " 


Au = 

-11 

, b - Au = 

2 

,||b-Au|hV40 


11 


-6 



7“ 


4“ 


Av = 

-12 

, b - Av = 

3 

, ||b-Av||= V29 


7 


-2 



Since Av is closer to b than Au is, Au is not the closest point in Col A to b. Thus u cannot be a least- 
squares solution of Ax = b. 
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14. One computes that 



“3“ 


“ 2" 

Au = 

8 

, b - Au = 

-4 


2 


2 


"7" 


~-2 

Av = 

2 

, b - Av = 

2 


8 


-4 


lb -Au 11= a/24 


, || b - Av ||= V24 


Since Au and Au are equally close to b, and the orthogonal projection is the unique closest point in Col A 
to b, neither Au nor Av can be the closest point in Col A to b. Thus neither u nor v can be a least-squares 
solution of Ax = b. 


15. The least squares solution satisfies Rx = Q b. Since R = 


3 5 
0 1 


for the system may be row reduced to find 


R Q T b] 


3 5 
0 1 


1 0 
0 1 


and so x = 


is the least squares solution of Ax = b. 


16. The least squares solution satisfies Rx - Q b. Since R — 
matrix for the system may be row reduced to find 


and Q J b = 


, the augmented matrix 


2 3 
0 5 


R <2 r b] = 


2 3 17/2 

0 5 9/2 


1 0 2.9 

0 1 .9 


and so x = 


2.9 

.9 


is the least squares solution of Ax = b. 


and Q r b = 


17/2 

9/2 


, the augmented 


17. a. True. See the beginning of the section. The distance from Ax to b is || Ax - b ||. 

b. True. See the comments about equation (1). 

c. False. The inequality points in the wrong direction. See the definition of a least-squares solution. 

d. True. See Theorem 13. 

e. True. See Theorem 14. 

18. a. True. See the paragraph following the definition of a least-squares solution. 

b. False. If x is the least-squares solution, then A x is the point in the column space of A closest to b. 
See Figure 1 and the paragraph preceding it. 

c. True. See the discussion following equation (1). 

d. False. The formula applies only when the columns of A are linearly independent. See Theorem 14. 

e. False. See the comments after Example 4. 

f. False. See the Numerical Note. 
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19. a. If Ax = 0, then A 7 Ax = A r 0 = 0. This shows that Nul A is contained in Nul A 7 A. 

b. If A 7 Ax = 0, then x 7 A 7 Ax - x r 0 = 0. So (Ax) T (Ax)=0, which means that ||Ax|| 2 = 0, and hence 
Ax = 0. This shows that Nul A 7 A is contained in Nul A. 


20. Suppose that Ax = 0. Then A r Ax = A r 0 = 0. Since A 7 A is invertible, x must be 0. Hence the columns of 
A are linearly independent. 

21. a. If A has linearly independent columns, then the equation Ax = 0 has only the trivial solution. By 

Exercise 17, the equation A r Ax = 0 also has only the trivial solution. Since A 7 A is a square matrix, 
it must be invertible by the Invertible Matrix Theorem. 

b. Since the n linearly independent columns of A belong to T m , m could not be less than n. 

c. The n linearly independent columns of A form a basis for Col A, so the rank of A is n. 

22. Note that A 7 A has n columns because A does. Then by the Rank Theorem and Exercise 19, 

rank A 7 A- n - dim Nul A 1 A - n - dim Nul A = rank A 


23. By Theorem 14, b = Ax = A(A'A) 1 A 7 b. The matrix A(A 7 A) 1 A 7 is sometimes called the hat-matrix in 
statistics. 

24. Since in this case A 7 A = I, the normal equations give x = A r b. 


"2 2" 

X 


"6" 

2 2 

_y_ 


6 


25. The normal equations are = , whose solution is the set of all (x, y) such that x + y = 3. 

[2 2_]|_yJ [6 

The solutions correspond to the points on the line midway between the lines x + y - 2 and x + y = 4. 

26. [M] Using .7 as an approximation for V2/2, a 0 =a 2 ~ .353535 and «, = .5. Using .707 as an 
approximation for V2/2, a 0 = a 2 ~ .35355339 , a l — .5. 


6.6 SOLUTIONS 


Notes: This section is a valuable reference for any person who works with data that requires statistical 
analysis. Many graduate fields require such work. Science students in particular will benefit from Example 1 . 
The general linear model and the subsequent examples are aimed at students who may take a multivariate 
statistics course. That may include more students than one might expect. 


1. The design matrix X and the observation vector y are 


T 

0 " 


V 

l 

1 

• y = 

l 

l 

2 

2 

l 

3_ 


2 


and one can compute 




4 

6 


6 

14 




6 

11 


ft — (x T xy 1 X T y ■ 


.9 

.4 


The least-squares line y - 0 O + > t x is thus y = .9 + .4x. 
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2. The design matrix X and the observation vector y are 


"l 

f 


"o" 

1 

2 

.y = 

1 

1 

4 

2 

1 

5_ 


3 


and one can compute 




4 

12 


12 

46 


x T y 


6 

25 


J=(X T X)~ 1 X T y: 


-.6 

.1 


The least-squares line y - 0 O + 0 x x is thus y = -.6 + .lx. 


3. The design matrix X and the observation vector y are 


"l 

-f 


"0" 

1 

0 

,y = 

i 

1 

1 

2 

1 

2 


4 


and one can compute 


"4 2" 


“ 7“ 


"l.f 


. V r y = 


,(J=(X T Xy 1 X T y = 


2 6 


10 


13 


The least-squares line y - 0 O + 0 x x is thus y - 1.1 + 1.3.x. 


4 . The design matrix X and the observation vector y are 


"l 

1 


"3" 

1 

3 

>y = 

2 

1 

5 

1 

1 

6 


0 


and one can compute 




4 

16 


16 

74 


,* r y = 


6 

17 


, 0 ~(x T xy l x T y ■ 


4.3 

-.7 


The least-squares line y - 0 O + 0 x x is thus y = 4.3 - .lx. 


5. If two data points have different x-coordinates, then the two columns of the design matrix X cannot be 
multiples of each other and hence are linearly independent. By Theorem 14 in Section 6.5, the normal 
equations have a unique solution. 


6. If the columns of X were linearly dependent, then the same dependence relation would hold for the 
formed from the top three entries in each column. That is, the columns of the matrix 

would also be linearly dependent, and so this matrix (called a Vandermonde matrix) 


vectors 

in R‘ 

1 

Xi 

2 

Xi 

1 

x 2 

2 

x 2 

1 

x 3 

2 

x 3 


would be noninvertible. Note that the determinant of this matrix is (x 2 - x, )(x 3 - x, )(x 3 - x 2 ) A 0 since 
Xj , x 2 , and x 3 are distinct. Thus this matrix is invertible, which means that the columns of X are in fact 
linearly independent. By Theorem 14 in Section 6.5, the normal equations have a unique solution. 
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7. a. The model that produces the correct least-squares fit is y = XB + e, where 


“l 

f 


"1.8" 




e i 

2 

3 

4 

9 

.y = 

2.7 

3.4 

,P = 

1 1 

to i— 

1 1 

, and e = 

e 2 

e 3 

4 

16 


3.8 



e 4 

_5 

25_ 


3.9 




_ e 5_ 


b. [M] One computes that (to two decimal places) fi — 


1.76 

-.20 


y = 1.76x-.20x . 


so the desired least-squares equation is 


8. a. The model that produces the correct least-squares fit is y = Xfi + e, where 


2 3 

x 1 x 1 x l 

.y = 

yi 

,P = 

i 

^ "Go 

to H- 

, and e — 

€ i 

2 3 

XXX 
L n n n J 


i 

a 

i 


1 

co 

1 


Jn_ 


b. [M] For the given data, 


“ 4 

16 

64" 


"1.58" 

6 

36 

216 


2.08 

8 

64 

512 


2.5 

10 

100 

1000 

and y = 

2.8 

12 

144 

1728 

3.1 

14 

196 

2744 


3.4 

16 

256 

4096 


3.8 

18 

324 

5832_ 


4.32 


so fi =(X T Xy'X T y = 


.5132 

-.03348 

.001016 


, and the least-squares curve is y = . 5132v -.03348.* 2 + .001016x 3 . 


9. The model that produces the correct least-squares fit is y = Xfi + e, where 


cos 1 

sin 1 


“7.9“ 




e i 






a“ 


cos 2 

sin 2 

-y = 

5.4 

,0 = 

B 

, and e - 

e 2 

cos 3 

sin 3 


-.9 




„ e 3_ 


10. a. The model that produces the correct least-squares fit is y = Xfi + e, where 


r^— .02(10) 

-.07(10)1 


_ 




e 

e 


21.34 



e i 

g -.02(ll) 

£-.07(11) 


20.68 




e 2 






r m. 



£-.02(12) 

£-.07(12) 

.y = 

20.05 

,0 = 

A 

, and e — 

e 3 




m b _ 



£-.02(14) 

£-.07(14) 


18.87 



e 4 

£-.02(15) 

£-.07(15) 


18.30 



_ e 5_ 
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b. [M] One computes that (to two decimal places) 0 = 


y -19.94e~ 02 ' + lO.lOe - ' 07 '. 


so the desired least-squares equation is 


11. [M] The model that produces the correct least-squares fit is y = Xft + e, where 
1 3 cos. 88 3 e, 

1 2.3 cos 1.1 2.3 r- e. 


X= 1 1.65 cos 1.42 ,y= 1.65 ,0 = 

1 1.25 cos 1.77 1.25 

1 1.01 cos 2.14 1.01 


and e - e. 


One computes that (to two decimal places) ft — 


. Since e = .811 < 1 the orbit is an ellipse. The 


equation r - ft / (1 - e cos if) produces r = 1 .33 when i) = 4.6. 

12. [M] The model that produces the correct least-squares fit is y = Xft + e, where 

"1 3.781 [ 9ll [ej" 

1 4.11 98 r n e 9 


X= 1 4.41 , y = 103 , ft 

1 4.73 110 

1 4.88 112 


, and e = €•, 


One computes that (to two decimal places) ft 


, so the desired least-squares equation is 


p = 18.56 + 19.24 In w. When w = 100, p ~ 107 mi llimeters of mercury. 

13. [M] 

a. The model that produces the correct least-squares fit is y = Xft + e, where 


0 

0 

0 

1 

1 

1 

2 

2 2 

2 3 

3 

3 2 

3 3 

4 

4 2 

4 3 

5 

5 2 

5 3 

6 

6 2 

6 3 

7 

7 2 

7 3 

OO 

8 2 

8 3 

9 

9 2 

9 3 

10 

10 2 

10 3 

11 

ll 2 

ll 3 

12 

12 2 

12 3 


, 29.9 

3 

62.0 

4 3 

4 104.7 

5 159.1 

6 3 ,y= 222.0 ,0 = 

7 3 294.5 

8 3 380.4 

9 s 471.1 

o 3 571J 

, 686.8 

l 3 

809.2 


, and e = 
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One computes that (to four decimal places) fi - 


y(t ) = -.8558 + 4.7025t + 5.5554r - ,0274t 3 . 


-.8558 

4.7025 

5.5554 

-.0274 


so the desired least-squares polynomial is 


b. The velocity v(t') is the derivative of the position function y(t), so v{t) — 4.7025 + 11.1 108? — .0822? 2 , 
and v(4.5) = 53.0 ft/sec. 

14. Write the design matrix as [1 x] . Since the residual vector e = y - X (3 is orthogonal to Col X, 

0 — l-€ — l-(y — X^) — l r y — (l r X)fi 


= (yi +•••+>'„)-[« Y x _ 


0o 

A. 


=Yy~ n A - 0 iZj x ~ n y - n A - n 00 


This equation may be solved for y to find y — /3 0 + 0 x x. 
15. From equation (1) on page 420, 




* r y = 


“ 1 . 

.. 1 " 

1 X| 


n Y x " 

_X[ • 

• • 

1 

>— k 

a * • 

1 


_Z x <Z x ) 2 _ 


" 1 . 

. 1 " 

y\ 


rz?i 

.Xl • 

• X n_ 



_Y x y_ 


The equations (7) in the text follow immediately from the normal equations X T X /3 -X T y. 


16. The determinant of the coefficient matrix of the equations in (7) is «^x 2 -(^x) 2 . Using the 2x2 
formula for the inverse of the coefficient matrix, 


i 

o 

i 

|Z x2 

M 

X 

i 


1 

i 

nix 2 -(^x) 2 

l_-Z x 

n J 

_Y xy _ 


Hence 

5 _ (Z * 2 xZ y) ~ <Z x xZ -*y) n _ »Z^~(Z*xZy) 

nX.x 2 -(X.x) 2 Wl n^V-^.x) 2 

Note: A simple algebraic calculation shows that Y y - x) /3, = nf3 0 , which provides a simple formula 
for (3 0 once /3, is known. 


17. a. The mean of the data in Example 1 is x = 5.5, so the data in mean-deviation form are (-3.5, 1), 


(-.5, 2), (1.5, 3), (2.5, 3), and the associated design matrix is X = 


1 

1 

1 

1 


-3.5 


-.5 

1.5 

2.5 


The columns of X are 


orthogonal because the entries in the second column sum to 0. 
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b. The normal equations are X T X (3 = X T y, or 


"4 

0 " 

00 


9 

0 

21 

A. 


_7.5_ 


. One computes that j3 — 


so the desired least-squares line is y — (9/4) + (5 / 14)jc = (9/4) + (5/ 14)(jc — 5.5). 
18. Since 


9/4 
5/14 ’ 


" 1 . 

.. 1 " 

1 X[ 


n Yj X 

_x> • 

.. x„_ 

1 

• 

1 


_Z x (Z-) 2 . 


X T X is a diagonal matrix when ^ x = 0. 


19. The residual vector e = y - X j3 is orthogonal to Col X, while y =X (3 is in Col X. Since e and y are 
thus orthogonal, apply the Pythagorean Theorem to these vectors to obtain 

SS(T) = || y || 2 = || y + e || 2 = || y || 2 + 1| e || 2 = || X$ || 2 + \\y-X$ || 2 = SS(R) + SS(E) 

20. Since j3 satisfies the normal equations, X 1 X (3 -X T y, and 

|| X0 || 2 = (XP) T (X/3) = P t X t X/3 = p T X T y 
Since \\ X /3 || 2 = SS(R) and y T y = || y || 2 = SS(T) , Exercise 19 shows that 
SS(E) = SS(T) -SS(R) = y r y - p T X T y 


6.7 SOLUTIONS 


Notes: The three types of inner products described here (in Examples 1, 2, and 7) are matched by examples in 
Section 6.8. It is possible to spend just one day on selected portions of both sections. Example 1 matches the 
weighted least squares in Section 6.8. Examples 2-6 are applied to trend analysis in Seciton 6.8. This material 
is aimed at students who have not had much calculus or who intend to take more than one course in statistics. 

For students who have seen some calculus, Example 7 is needed to develop the Fourier series in 
Section 6.8. Example 8 is used to motivate the inner product on C[a, b\. The Cauchy-Schwarz and triangle 
inequalities are not used here, but they should be part of the training of every mathematics student. 


1. The inner product is (x, y ) = 4x, y, + 5x 2 y 2 . Let x = (1, 1), y = (5, -1). 

a. Since || x || 2 = (x, x) = 9, || x || = 3. Since || y || 2 = (y, y) - 105, ||x||=Vl05. Finally, 

|<x,y>| 2 =15 2 =225. 

b. A vector z is orthogonal to y if and only if (x, y) - 0, that is, 20 x, - 5z 2 = 0, or 4 z 1 - z 2 - Thus all 


multiples of 


1 

4 


are orthogonal to y. 


2. The inner product is {x,y) = 4x l y l +5x 2 y 2 - Let x = (3, -2), y = (-2, 1). Compute that ||x||“ = (x,x} = 56, 

II y || 2 =(y> y) = 21, || x || 2 || y |p = 56-21 = 1176 , (x, y> = -34, and | (x, y) | 2 = 1156 . Thus 

|(x, y)| 2 < || x || 2 || y || 2 , as the Cauchy-Schwarz inequality predicts. 

3. The inner product is ( p,q ) = p{-\)q{-\) + p(0)q(0) + p(l)q(l), so (4 + 1,5 - 4t 2 ) - 3(1) + 4(5) + 5(1) = 28. 
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4. The inner product is ( p,q ) = p(-l)g(-l) + p(0)g(0) + p(l)<7(l), so <3? -t 2 , 3 + 2/ 2 } = 

(— 4)(5) + 0(3) + 2(5) = -10. 

5. The inner product is {p,q)~ p{-\)q(-\) + p(0)q(0) + p(X)q(\), so 

(p,q) = (4 + tA + t) = 3 2 +4 2 +5 2 = 50 and || p ||= p,p ) = -\/50 -5^2 . Likewise 

(g.g) = (5-4/ 2 ,5-4/ 2 ) = 1 2 +5 2 +1 2 =27 and \\q ||= ^{q,q) = ^27 = 3V3 . 

6. The inner product is (p,q) = p(-l)q(-l) + p(0)g(0) + p(l)g(l), so {p, p) ~{3t -t 2 ,3t -t 2 ) - 
(_4) 2 +0 2 + 2 2 =20 and || p ||= ^/<p, p) = V20 = 2^5. Likewise (4,4) = <3 + 2/ 2 ,3 + 2/ 2 > = 
5 2 +3 2 +5 2 =59 and || q ||= ^q) = V59. 


7 . The orthogonal projection <7 of q onto the subspace spanned by p is 

» < q,p ) 28 . 56 14 

q = p = — (4 + 0 = — + — ? 

<p,p> 50 25 25 


8. The orthogonal projection q of q onto the subspace spanned by p is 


ApL p =JA ( 3( . 

(p,p) 20 


2, 3 1 2 

/ ) = — / + -/ 
2 2 


9 . The inner product is (p, q) - p(-3)q(-3) + p(-l)q(-l) + p(\)q(\) + p(3)q(3). 

a. The orthogonal projection p 2 of p 2 onto the subspace spanned by p 0 and p l is 


- Ovft) 20 A (=J 

(P«,P«) (Pi'Pi) 4 20 


^ 2 

b. The vector q-p 3 -p 2 -t~-5 will be orthogonal to both p Q and p, and { p {) ,p t ,q] will be an 
orthogonal basis for Span{p 0 ,pj,p.,}. The vector of values for q at (-3, -1, 1 , 3) is (4, -4, —4, 4), so 
scaling by 1/4 yields the new vector q - (l/4)(/ 2 -5). 


10 . The best approximation to p -t 3 by vectors in W = Span} p (r p r q\ will be 
P - P ro j w p 


(P-Po) <P.p.) + = 0 164 0 

(Po.Po) ' (V/V <?.?> 4 20 4 


^/ 2 - 5 ^ 


41 


11 . The orthogonal projection of p = / 3 onto W — S pan { p 0 , p, , p 2 } will be 

34 
10 


(P,P 0 ) , (P>Pi) , <P ? P 2 > 0 2 17 

P = proj w p = 7 -Pq + ~ ~Pi+ ~P 2 = 7(1) + — (0 + — (/ -2 ) = ~t 


(Po’Po) (PvPl) <P 2 ,P 2 > 


12 . Let W = Span{p 0 ,p 1 ,p 2 }. The vector p 3 = p -proj w p = / 3 -(17/5)/ will make {Po,P!,p 2 ,p 3 } 
an orthogonal basis for the subspace P 3 of P 4 . The vector of values for p 3 at (-2, -1,0, 1,2) is 
(-6/5, 12/5, 0, -12/5, 6/5), so scaling by 5/6 yields the new vector p 3 - (5/6 )(/ 3 - (17 /5)/) = 
(5/6)/ 3 -(17/6)/. 
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13. Suppose that A is invertible and that (u, v) = (Au) • (Av) for u and v in R". Check each axiom in the 
definition on page 428, using the properties of the dot product. 

i. <u, v) - (Au) • (Av) = (Av) • (Au) - <v, u> 

ii. <u + v, w> = (A(u + v)) • (Aw) = (Au + Av) • (Aw) = (Au) • (Aw) + (Av) • (Aw) = (u, w) + (v, w> 

iii. (cu, v> = (A(cu)) • (Av) = (c(Au)) • (Av) = c((Au) • (Av)) = c(u, v> 

iv. (cu,u) = (Au) • (Au) = || Au || 2 > 0, and this quantity is zero if and only if the vector Au is 0. But 
Au = 0 if and only u = 0 because A is invertible. 

14. Suppose that T is a one-to-one linear transformation from a vector space V into R" and that (u, v) = 

J(u) • T(y) for u and v in R". Check each axiom in the definition on page 428, using the properties of the 
dot product and T. The linearity of T is used often in the following. 

i. <u, v) - r(u) • r(v) = 7Tv) • r(u) - <v, u> 

ii. (u + v, w) = 7’(u + v) • T( w) = (7Tu) + 7Tv)) ■ T( w) = 7Tu) ■ T( w) + 7Tv) ■ T{ w) = (u, w) + (v, w> 

iii. (cu, v> = T(cu) ■ T(\) = (cT(u)) ■ T(\) - c(T(u) ■ T(\)) = c(u, v) 

iv. <u,u> = r(u) • r(u) = || r(u) || 2 > o, and this quantity is zero if and only if u = 0 since T is a one-to- 
one transformation. 


15. Using Axioms 1 and 3, (u, cv) = (cv, u) = c(v, u> = c(u, v>. 

16. Using Axioms 1, 2 and 3, 

II u _ v |P = ( u _ V,U “ v ) = (u,U - v) - (v,u - v) 

= <U,U> - (u, v> - <v,u> + (v, v> = <u,u> - 2(u, v) + (v, v> 

= ||u|| 2 -2(u,v) + || v|| 2 

Since {u, v} is orthonormal, || u || 2 = || v || 2 = 1 and (u, v) = 0. So || u - v || 2 = 2. 


17. Following the method in Exercise 16, 

II u + v |P = ( u + V,u + v> = (u,u + v) + (v,u + v) 

= <U,u) + (u, v) + < V,U> + < V, v> = <u,u> + 2(u, v) + ( V, v> 

= II u IP +2(u,v) + || v IP 

Subtracting these results, one finds that || u + v || 2 - 1| u - v || 2 = 4(u, v), and dividing by 4 gives the 
desired identity. 

18. In Exercises 16 and 17, it has been shown that || u — v |p = || u |p -2(u, v) + 1| v |p and || u + v |p = 

|| u || 2 + 2(u, v) + 1| v || 2 . Adding these two results gives || u + v |p + 1| u - v |p = 2 1| u |p + 2 1| v |p . 


19. let u = 


Vu 

4~b 


and v = 


s 


. Then || u |p = a + b , || v |p = a + b , and (u, v) = 2\fab. Since a and b are 


nonnegative, || u ||= \J a + b , || v ||= yja + b. Plugging these values into the Cauchy-Schwarz inequality 
gives 

2\[ab = | (u, v) | < ||u||||v|| = V« + ^V« + ^ : =fl + ^ 

Dividing both sides of this equation by 2 gives the desired inequality. 
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20. The Cauchy-Schwarz inequality may be altered by dividing both sides of the inequality by 2 and then 
squaring both sides of the inequality. The result is 

|W | 2 < HM 


ri jl .. 2 o 2 ii 1 12 

Now let u = and v = . Then || u ||" = a +b , ||v|| = 2 , and (u, v) = a + b. Plugging these values 

b\ _lj 

into the inequality above yields the desired inequality. 

21. The inner product is (/,g) = ^f(t)g(t)dt. Let f(t) = l-3t 2 , g(t) -t -t 3 . Then 


<f,g)= [{l-3t 2 ){t-t 3 )dt = 


5 - At 3 + 1 dt - 0 


22. The inner product is (f,g)= f f{t)g{t)dt. Let/(f) = 5? - 3, g{t) = t 3 -t 2 . Then 

(f,g) = f (5t-3)(t 3 -r)dt = £ 5t 4 -8t 3 +3t 2 dt =0 

23. The inner product is (f,g)= f f(t)g(t) dt, so (/,/) = J^(l -3t 2 ) 2 dt - J^9 1 4 - 6t 2 + 1 dt = 4/5, 

ll/ll=7<7T7> = 2/^5. 


24. The inner product is {f ,g) ~ \f{t)g(t) dt, so (g,g) - ^(t 3 -t 2 ) 2 dt - J^t 6 -2t 5 + t 4 dt - 1/105, and 

\\g\\= J(g’g) =l/%/l05. 


pi pi 

25. The inner product is ( f,g ) = J \ f (t)g(t)dt. Then 1 and t are orthogonal because <1, t) = J t dt- 0. So 1 

and t can be in an orthogonal basis for S pan { 1 , t,t 2 }. By the Gram-Schmidt process, the third basis 
element in the orthogonal basis can be 

2 <f 2 ,l ) 1 (t 2 ,t) 

<U> <t,t) 

Since (t 2 ,l)- ^t 2 dt = 2/3, (1,1)= j ^ldt = 2, and (t 2 ,t) = ^t 3 dt = 0, the third basis element can be 
written as t 2 -(1/3). This element can be scaled by 3, which gives the orthogonal basis as {1, t, 3 1 2 -1}. 

r 2 r 2 

26. The inner product is ( f,g )= f{t)g{t)dt. Then 1 and t arc orthogonal because (!,?)= t dt = 0. So 1 

J— 2 J— 2 

and t can be in an orthogonal basis for Span{l, t, V } . By the Gram-Schmidt process, the third basis 
element in the orthogonal basis can be 

f 2 <f 2 .l), {t 2 ,t) 

<U> <t,t) 

Since (t 2 ,l)= f t 2 dt = 16/3, (1,1)= f \dt = A, and (t 2 ,t)= [ t 3 dt = 0, the third basis element can be 

J— 2 J— 2 J— 2 

2 2 

written as t - (4/3). This element can be scaled by 3, which gives the orthogonal basis as {1, t, 3 1 - 4}. 
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27. [M] The new orthogonal polynomials are multiples of -lit + 5l 3 and 72 — 1 55? 2 + 35f 4 . These 
polynomials may be scaled so that their values at -2, -1,0, 1, and 2 are small integers. 

28. [M] The orthogonal basis is f 0 (t) - 1, /j(t) = cost, f 2 (t) - cos 2 t -(1/2) = (l/2)cos 2t, and 
f 3 (t) -cos 3 t -(3/4)cos t - (l/4)cos 3 1. 


6.8 SOLUTIONS 


Notes: The connections between this section and Section 6.7 are described in the notes for that section. For 
my junior-senior class, I spend three days on the following topics: Theorems 13 and 15 in Section 6.5, plus 
Examples 1, 3, and 5; Example 1 in Section 6.6; Examples 2 and 3 in Section 6.7, with the motivation for the 
definite integral; and Fourier series in Section 6.8. 


1. The weighting matrix W, design matrix X, parameter vector / 3 , and observation vector y are: 


"l 

0 

0 

0 

0 " 


T 

-2" 


"o" 

0 

2 

0 

0 

0 


l 

-1 


1 1 

H- O 

i i 


0 

0 

0 

2 

0 

0 

,x=. 

l 

0 

,P = 

,y = 

2 

0 

0 

0 

2 

0 


l 

1 



4 

0 

0 

0 

0 

1 


l 

2 


4 


The design matrix X and the observation vector y are scaled by W: 


WX 


"l -2 


"o" 

2 -2 


0 

2 0 

,Wy = 

4 

2 2 


8 

1 2 


4 


further compute 


( wxywx = 


14 

o 


o 

16 


AWXfWy 


28 

24 


and find that 


f3 ={{WX) r WXy\WX) r Wy = 


"1/14 

0" 

"28" 


2" 

0 

1/16 

24 


3/2_ 


Thus the weighted least-squares line is y = 2 + (3/2)x. 


2. Let X be the original design matrix, and let y be the original observation vector. Let W be the weighting 
matrix for the first method. Then 2W is the weighting matrix for the second method. The weighted least- 
squares by the first method is equivalent to the ordinary least-squares for an equation whose normal 
equation is 

(WX) r WX/3 =(WX) T Wy (1) 

while the second method is equivalent to the ordinary least-squares for an equation whose normal 
equation is 

(2WX) T (2W)X /3 = {2WX) T {2W)y (2) 

Since equation (2) can be written as 4 (WX) T WX (3 - MWXflVy , it has the same solutions as 
equation (1). 
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3. From Example 2 and the statement of the problem, p 0 (t)-l, p x (t)-t, p 2 (t)-t - 2, 

p 3 (t) - (5/6)? ' -(17/6)?, and g = (3, 5, 5, 4, 3). The cubic trend function for g is the orthogonal 
projection p of g onto the subspace spanned by p 0 , p x , p 2 , and p 3 : 


^<SiJ^ Pa + iSiJhl P[+ (h£2L P2+ <£i£}l Pj 

(PO’Po) (Pl’Pl) (Pl’Pl) (Pl’Pl) 



This polynomial happens to fit the data exactly. 


4 . The inner product is (p,q) = p(-5)q(-5) + p(-3)q(-3) + p(-l)q(-l) + p(\)q(l) + p(3)q(3) + p(5)q(5). 

a. Begin with the basis {1, ?, ? 2 } for P 2 . Since 1 and ? are orthogonal, let p 0 (t) = 1 and p x (t) = ?. Then 
the Gram-Schmidt process gives 


p 2 (t) = t 2 - 


(? 2 ,1) (? 2 ,?) 2 

<1,1> <?,?> 


70 

6 


35 

3 


The vector of values for p 2 is (40/3, -8/3, -32/3, -32/3, -8/3, 40/3), so scaling by 3/8 yields the new 
function p 2 = (3 / 8)(? 2 - (35 / 3)) = (3 / 8)? 2 - (35 / 8). 

b. The data vector is g = (1, 1, 4, 4, 6, 8). The quadratic trend function for g is the orthogonal projection 
p of g onto the subspace spanned by p 0 , /;, and p 2 : 


P = 


(Po’Po) 


P^- Pt+ 

(PuPl) 


{g-pl) 

(Pl’Pl) 


24 50 6 

P 2 — (1) H ? H 

6 70 84 




= 4 


5 1 

H 1 H 

7 14 



35 ) 59 5 3 2 

16 7 112 


pZTT 

5 . The inner product is ( f,g)= f(t)g(t)dt. Let n. Then 

| p2- 

(sin mt , sin /??) = sin m? sin /7? <7? = — J q cos ((m - 77 )?) - cos ((m + n)t)dt = 0 

Thus sin mt and sin nt are orthogonal. 

f 27T 

6. The inner product is </, g) = I f(t)g(t)dt. Let m and n be positive integers. Then 

p27T _ 1 p27T 

(sin mt, cos nt) = sin mt cos nt dt - — sin((m + n)t) + sin ((m - n)t)dt = 0 


Thus sinm? and cosn? are orthogonal. 
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pZ7T 

7. The inner product is (/, g) = I f(t)g(t)dt. Let k be a positive integer. 

1 1 2 f" 71 2 1 f" 77 

: kt || = (cos kt,cos kt) = cosktdt- — 1 + cos 2kt dt - tt 


cos , 


and 


a 0 11 r 2 ' 


II Il2 C Z7r 2 1 f^r 

|| sin kt ||= (sin fcf,sin fct) = sin~Z:t dt = — \ - cos 2kt dt - tt 

8. Let ft t) = t - 1. The Fourier coefficients for/are: 

J_ 

2tt 


rlit I i»27T 

£ /(/)* = — _[ f-l</f = -l + i 


2 2 7T 

and for > 0, 

1 f27r 1 j-2: 

a k ~ — I f(t)cos kt dt - — I (t - l)cos ktdt=0 

7 T J ° 7T J0 

1 f2~ 1 p2- 2 

b k — — I /(f)sin kt dt - — I (t - l)sin kt dt - — 

7T 7T Jo & 

The third-order Fourier approximation to/is thus 

ci 'IL 

+ ZtjSin t + Zr,sin 2 1 + Z> 3 sin 3t — -1 + -it - 2 sin t - sin 2t - — sin 3 1 


9. Let J{t) -2i t - t. The Fourier coefficients for/ are: 

J_ 

2-7T 


a o 1 1 r 277 z- / \ j 1 r 27r ,, , 

- f(t)dt- — 2-K-tdt-TT 


2 2 TT 

and for k > 0, 

1 fin , , 1 r 2yr 

TT 

1 f2- 

7T 


I 1 pZ7T 

G k — — I f{t) cos kt dt I (2tt -t) cos kt dt - 0 

TT JO 7T 

1 f2- 1 p2r 2 

b k - — I fit) sin kt dt- — I (27t - 1) sin kt dt - — 

TT JO ' ' n JO £ 

The third-order Fourier approximation to/is thus 


^ 2 
-y- + Zt,sin t + Z> 2 sin 2 1 + Z> 3 sin 3t - tt + 2 sin t + sin 2 1 + —sin 3f 


10 . Let /(/) = • 


1 for 0 < t < 7T 
-1 for 7T < t < 27T 


. The Fourier coefficients for/ are: 


G 0 11 f2- 


2 2 7T 

and for k > 0, 


/•2tt I rr 1 i*27T 

[ fit) dt - — [ dt [ dt = 0 

Jo 27 t Jo 2tt ^ 


1 f' | r 1 r 2 : 

a t -—\ fit) cos kt dt- — I cos kt dt I cos kt dt - 0 

qr JO qr JO -qr J/T 


1 1*2“ 1 ffT 1 1*2“ 

b k = — I /(f) sin kt dt- — I sin fe I sin kt dt = 

•tt JO 77- JO tt J/T 


|4/(^7t) 

0 


The third-order Fourier approximation to/is thus 
4 4 

fesin t + Zr,sin 3t - — sin t h sin 3 1 

TT 37T 


Then 


for k odd 
for k even 
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11. The trigonometric identity cos 2t - 1 -2 sinY shows that 

.2 11 

sin t = cos 2 1 

2 2 

The expression on the right is in the subspace spanned by the trigonometric polynomials of order 3 or 
less, so this expression is the third-order Fourier approximation to cosY . 


12. The trigonometric identity cos 3t - 4 cos Y - 3 cos t shows that 

1 

cos t = —cos t + —cos 3 1 
4 4 

The expression on the right is in the subspace spanned by the trigonometric polynomials of order 3 or 
less, so this expression is the third-order Fourier approximation to cosY 


13. Let/ and g be in C [0, 2tt] and let m be a nonnegative integer. Then the linearity of the inner product 
shows that 

((/+ g ), cos mi) = (/, cos mt) + (g, cos mi), ((/+ g), sin mt ) = (/, sin mi) + ( g, sin mi) 

Dividing these identities respectively by (cos mt, cos mi) and (sin mt, sin mt) shows that the Fourier 
coefficients a m and b m for f + g are the sums of the corresponding Fourier coefficients of / and of g. 


14. Note that g and h are both in the subspace H spanned by the trigonometric polynomials of order 2 or less. 
Since h is the second-order Fourier approximation to / it is closer to/than any other function in the 
subspace H. 


15. [M] The weighting matrix IT is the 13 x 13 diagonal matrix with diagonal entries 1, 1, 1, .9, .9, .8, .7, .6, 
.5, .4, .3, .2, .1. The design matrix X, parameter vector J| and observation vector y are: 


1 

0 

0 

0 

1 

1 

1 

1 

1 

2 

2 2 

2 3 

1 

3 

3 2 

3 3 

1 

4 

4 2 

4 3 

1 

5 

5 2 

5 3 

1 

6 

6 2 

6 3 

1 

7 

7 2 

7 3 

1 

8 

8 2 

8 3 

1 

9 

9 2 

9 3 

1 

10 

10 2 

10 3 

1 

11 

ll 2 

ll 3 

1 

12 

12 2 

12 3 


0.0 


• y = 


29.9 

62.0 

104.7 

159.1 
222.0 
294.5 
380.4 

471.1 

571.7 

686.8 

809.2 
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The design matrix X and the observation vector y are scaled by W: 


"1.0 

0.0 

0.0 

0.0" 


0.00" 

1.0 

1.0 

1.0 

1.0 


8.80 

1.0 

2.0 

4.0 

8.0 


29.90 

.9 

2.7 

8.1 

24.3 


55.80 

.9 

3.6 

14.4 

57.6 


94.23 

.8 

4.0 

20.0 

100.0 


127.28 

.7 

4.2 

25.2 

151.2 

,Wy« 

155.40 

.6 

4.2 

29.4 

205.8 


176.70 

.5 

4.0 

32.0 

256.0 


190.20 

.4 

3.6 

32.4 

291.6 


188.44 

.3 

3.0 

30.0 

300.0 


171.51 

.2 

2.2 

24.2 

266.2 


137.36 

.1 

1.2 

14.4 

172.8 


80.92_ 


Further compute 


0 wxfwx 


6.66 

22.23 

120.77 

797.19" 


747.844" 

22.23 

120.77 

797.19 

5956.13 

,(WX) T Wy = 

4815.438 

120.77 

797.19 

5956.13 

48490.23 

35420.468 

797.19 

5956.13 

48490.23 

420477.17 


285262.440 


and find that 


p ={(WXj r WX)-\WXj r Wy = 


-0.2685 

3.6095 

5.8576 

-0.0477 


Thus the weighted least-squares cubic is y = g(t)- -.2685 + 3.6095? + 5.8576? 2 - .0477 f 3 . The velocity 
at t = 4.5 seconds is g’(4.5) = 53.4 ft./sec. This is about 0.7% faster than the estimate obtained in Exercise 
13 of Section 6.6. 


16. [M] Let /(?)=< 


1 for 0 < t < 7r 


1 


for all k > 0 and b, = 


for 7T < t < 2 tt 
(4/(/ctt) for k odd 


. The Fourier coefficients for/have already been found to be a k -k) 


0 


for k even 


. Thus 


4 4 4 4 4 

f 4 (t) — — sin t H sin 3 1 and f 5 (t) — — sin t H sin 3 1 h sin 5? 

7T 37T 7T 37T 57T 

A graph of / 4 over the interval [0, 27r] is 
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A graph of f 5 over the interval [0, 27 t] is 



A graph of f 5 over the interval [-27 r, 27 t] is 



Chapter 6 SUPPLEMENTARY EXERCISES 

1. a. False. The length of the zero vector is zero. 

b. True. By the displayed equation before Example 2 in Section 6.1, with c - -1, || -x || = || (-l)x || = 

c. True. This is the definition of distance. 

d. False. This equation would be true if r|| v || were replaced by | r ||| v ||. 

e. False. Orthogonal nonzero vectors are linearly independent. 

f. True. If x ■ u = 0 and x ■ v = 0, then x-(u-v) = x- u- x- v = 0. 

g. True. This is the “only if” part of the Pythagorean Theorem in Section 6. 1 . 

h. True. This is the “only if” part of the Pythagorean Theorem in Section 6.1 where v is replaced 

by -v, because || -v || 2 is the same as || v [| 2 . 

i. False. The orthogonal projection of y onto u is a scalar multiple of u, not y (except when y itself is 
already a multiple of u). 

j. True. The orthogonal projection of any vector y onto W is always a vector in W. 

k. True. This is a special case of the statement in the box following Example 6 in Section 6. 1 (and 
proved in Exercise 30 of Section 6.1). 

l. False. The zero vector is in both W and W 1 . 

m. True. See Exercise 32 in Section 6.2. If v, • v , = 0, then (c, v, ) • (c, v , ) = c ; c , (v, • v , ) = c,c ,0 = 0. 

1 J i i J J 1 J 1 J 1 J 

n. False. This statement is true only for a square matrix. See Theorem 10 in Section 6.3. 

o. False. An orthogonal matrix is square and has orthonormal columns. 
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p. True. See Exercises 27 and 28 in Section 6.2. If [/has orthonormal columns, then U T U -I. If U is 
also square, then the Invertible Matrix Theorem shows that U is invertible and U~ l - U T . In this 
case, U T U — /, which shows that the columns of U T are orthonormal; that is, the rows of U are 
orthonormal. 

q. True. By the Orthogonal Decomposition Theorem, the vectors proj H v and v - pi'oj M v are 
orthogonal, so the stated equality follows from the Pythagorean Theorem. 

r. False. A least-squares solution is a vector x (not Ax) such that A x is the closest point to b 
in Col A. 

s. False. The equation x = (A T A) _1 A T b describes the solution of the normal equations, not the matrix 

form of the normal equations. Furthermore, this equation makes sense only when A 6 7 A is 
invertible. 

2. If {v 1 ,v 2 } is an orthonormal set and x = qvj + c 2 v 2 , then the vectors q v, and c 2 \ 2 are orthogonal 
(Exercise 32 in Section 6.2). By the Pythagorean Theorem and properties of the norm 

II X II ~ II C 1 V 1 + C 2 V 2 II ~ II C 1 V 1 II + II C 2 V 2 II ~ ( C 1 II V 1 II) + ( c 2 II V 2 ll)~ H C 1 I + I c 2 I 

So the stated equality holds for p = 2. Now suppose the equality holds for p = k, with k>2. Fet 
{ Vj, . . ., v fc+1 } be an orthonormal set, and consider x = q v, + ... + c k \ k +c t+1 v t+1 = u A , +c t+1 v t+1 , where 
u, =qvj + ... + c k \ k . Observe that u t and c k+l \ k+1 are orthogonal because v - • v i+1 =0 for j = 1 
By the Pythagorean Theorem and the assumption that the stated equality holds for k, and because 

II C k+l' V k+l II ~ I C k + 1 I II V A+1 II r I C k+\ I ’ 

ll x ll -|l u r +c r-+i v r-+i II ~ II u jt II” + II c /t+i v /t+i II H c il + --- + l c r+il 

Thus the truth of the equality for p = k implies its truth for p = k + 1 . By the principle of induction, the 
equality is true for all integers p > 2. 

3. Given x and an orthonormal set {v 1; . . ., v } in R", let x be the orthogonal projection of x onto the 

subspace spanned by . By Theorem 10 in Section 6.3, x = (x • v^v, + . . . + (x- v )v . By 

Exercise 2, || x || = | x • Vj | +. . . + 1 x • v | . Bessel’s inequality follows from the fact that || x || < || x || , 
which is noted before the proof of the Cauchy-Schwarz inequality in Section 6.7. 

4. By parts (a) and (c) of Theorem 7 in Section 6.2, {U\ l ,...,U\ k } is an orthonormal set in R". Since there 
are n vectors in this linearly independent set, the set is a basis for SL". 

5. Suppose that ( U x)-([/ y) = x-y for all x, y in R", and let e l5 ...,e„ be the standard basis for R". For 

j = 1, . . ., n, Ue j is the /th column of U. Since || [/e • || = ([/e ; ) • ([/e • ) = e • • e • = 1, the columns of U are 
unit vectors; since (Ue-) ■ (Ue k ) = e • • =0 for j ^ k, the columns are pairwise orthogonal. 

6. If Ux = ax for some x A 0, then by Theorem 7(a) in Section 6.2 and by a property of the norm, 

|| x || = || Ux || = || ?x || = | X HI x ||, which shows that | X \ - 1, because x ^ 0. 

7. Fet u be a unit vector, and let Q-I - 2uu r . Since (uu r ) T - u rr u r = uu r , 

Q r = (I- 2uu r ) r - / - 2(uu r ) r =1- 2uu r = Q 

Then 

QQ t -Q 2 - {I - 2uu r ) 2 - / - 2uu r - 2uu r + 4(uu r )(uu r ) 
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T rp rp rp rp rp 

Since u is a unit vector, u u = u • u = 1, so (uu )(uu ) = u(u )(u)u = uu , and 

QQ t - I - 2uu r - 2uu r + 4uu r = I 
Thus <2 is an orthogonal matrix. 

8. a. Suppose that x • y = 0. By the Pythagorean Theorem, || x || 2 + 1| y || 2 = || x + y || 2 . Since T preserves 

lengths and is linear, 

II T(x) || 2 + || T( y) || 2 = || T(x + y) || 2 = || T(x) + T( y) || 2 

This equation shows that T(x) and T(y) are orthogonal, because of the Pythagorean Theorem. Thus T 
preserves orthogonality. 

b. The standard matrix of T is [T(e,) ... Tie,,)] , where e, e„ are the columns of the identity 

matrix. Then {T(e 1 ),...,r(e„)} is an orthonormal set because T preserves both orthogonality and 
lengths (and because the columns of the identity matrix form an orthonormal set). Finally, a square 
matrix with orthonormal columns is an orthogonal matrix, as was observed in Section 6.2. 

9. Let W = Span{u, v}. Given z in R", let z = proj M z . Then z is in Col A, where A = [u v]. Thus there is 
a vector, say, x in R 2 , with A x = z . So, x is a least-squares solution of Ax = z. The normal equations 
may be solved to find x , and then z may be found by computing A x. 


10. Use Theorem 14 in Section 6.5. If c ^ 0, the least-squares solution of Ax = cb is given by 

T 1 T T 1 T 

(A A) A (cb), which equals c(A A) A b, by linearity of matrix multiplication. This solution is c 
times the least-squares solution of Ax = b. 



X 


o 


f 


V" 


"1 -2 5" 

11. Let x = 

y 

, b = 

b 

, v = 

-2 

, and A- 

v r 

= 

1 -2 5 


z 


c 


5 


v r 


1 -2 5 


. Then the given set of equations is 


Ax = b, and the set of all least-squares solutions coincides with the set of solutions of the normal 
equations A r Ax = A r b . The column-row expansions of A 7 A and A 7 b give 

A 1 A- xx T + vv r + vv r = 3vv r , A 7 b = ax + bx + cx - (a + b + c)v 
Thus A r Ax - 3(vv r )x = 3v(v r x) = 3(v r x)v since v r x is a scalar, and the normal equations have 
become 3(v r x)v = (a + b + c)v, so 3(v 7 x) -a + b + c, or \ T x-(a + b + c)/ 3. Computing v r x gives the 
equation x - 2y + 5z = (a + b + c)/3 which must be satisfied by all least-squares solutions to Ax = b. 


12. The equation (1) in the exercise has been written as VX = b, where Pis a single nonzero column vector v, 
and b = Ax. The least-squares solution X of VX = b is the exact solution of the normal equations 
V T VX - V r b. In the original notation, this equation is v 7 v/, = v r Av. Since v r v is nonzero, the least 
squares solution X is v 7 Av/(v r v). This expression is the Rayleigh quotient discussed in the Exercises 
for Section 5.8. 


13. a. The row -column calculation of Au shows that each row of A is orthogonal to every u in Nul A. So 
each row of A is in (Nul A) 1 . Since (Nul A) 1 is a subspace, it must contain all linear combinations 
of the rows of A; hence (Nul A) 1 contains Row A. 
b. If rank A = r, then dimNul A-n - r by the Rank Theorem. By Exercsie 24(c) in Section 6.3, 

dimNul A + dim(Nul A) 1 = n, so dim(Nul A) 1 must be r. But Row A is an r-dimensional subspace 
of (Nul A) 1 by the Rank Theorem and part (a). Therefore, Row A = (Nul A) 1 . 
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c. Replace A by A r in part (b) and conclude that Row A r = (Nul A 7 ) 1 . Since Row A r = Col A, 

Col A = (Nul A 7 ') 1 . 

14. The equation Ax = b has a solution if and only if b is in Col A. By Exercise 13(c), Ax = b has a solution 
if and only if b is orthogonal to Nul A 7 . This happens if and only if b is orthogonal to all solutions of 
A 7 x = 0. 

15. If A = URU t with U orthogonal, then A is similar to R (because U is invertible and U T - U ~ x ), so A has 
the same eigenvalues as R by Theorem 4 in Section 5.2. Since the eigenvalues of R are its n real diagonal 
entries, A has n real eigenvalues. 

16. a. If U = [u, u 2 ... u„], then AU = [A, 1 u 1 Au 2 ... Au„]. Since U] is a unit vector and 

u-,,...,u„ are orthogonal to u ]; the first column of U T AU is f/ r (A, 1 u 1 ) = A,[f/ r Uj =2,^. 
b. From (a), 



View U T AU as a 2 x 2 block upper triangular matrix, with A, as the (2, 2)-block. Then from 
Supplementary Exercise 12 in Chapter 5, 

det (U t AU - 'kl,,) =det((A.j - A.)/ 1 )-det(A 1 -kl n _ x ) - (A.j - k) ■ det(A, - kl n _ x ) 

This shows that the eigenvalues of U 1 AU, namely, /, j; , consist of k l and the eigenvalues of 
Aj . So the eigenvalues of A, are k 2 ,...,k n . 

17. [M] Compute that || Ax ||/|| x || = .4618 and cond(A) x (|| Ab || / 1| b ||) = 3363x (1.548 x 1(T 4 ) = .5206 . In 

this case, || Ax ||/|| x || is almost the same as cond(A) x || Ab ||/|| b ||. 

18. [M] Compute that || Ax ||/|| x || = .00212 and cond(A) x (|| Ab ||/|| b ||) = 3363 x (.00212) « 7.130. In this 

case, || Ax ||/|| x || is almost the same as || Ab ||/|| b ||, even though the large condition number suggests that 

|| Ax ||/|| x || could be much larger. 

19. [M] Compute that || Ax || / 1| x ||= 7.178 x 10 -8 and cond(A) x (|| Ab || / 1| b ||) = 23683 x (2.832 x 10 -4 ) = 
6.707. Observe that the realtive change in x is much smaller than the relative change in b. In fact the 
theoretical bound on the realtive change in x is 6.707 (to four significant figures). This exercise shows 
that even when a condition number is large, the relative error in the solution need not be as large as you 
suspect. 

20. [M] Compute that || Ax ||/|| x || = .2597 and cond(A) x (|| Ab || / 1| b || ) = 23683 x (1.097 x 10 -5 ) = .2598 . This 
calculation shows that the relative change in x, for this particular b and Ab, should not exceed .2598. In 
this case, the theoretical maximum change is almost acheived. 




Symmetric Matrices 
and Quadratic 
Forms 


7.1 SOLUTIONS 


Notes: Students can profit by reviewing Section 5.3 (focusing on the Diagonalization Theorem) before 
working on this section. Theorems 1 and 2 and the calculations in Examples 2 and 3 are important for the 
sections that follow. Note that symmetric matrix means real symmetric matrix , because all matrices in the text 
have real entries, as mentioned at the beginning of this chapter. The exercises in this section have been 
constructed so that mastery of the Gram-Schmidt process is not needed. 

Theorem 2 is easily proved for the 2x2 case: 


If A = 


a b 
c d 


, then X = ^a + d± sj(a-d) 2 + 4 b 2 


If b = 0 there is nothing to prove. Otherwise, there are two distinct eigenvalues, so A must be diagonalizable. 


In each case, an eigenvector for X is 


d -X 
-b 


1. Since A = 


2 . Since A = 


3. Since A = 


3 5 

5 -7 

-3 5' 

-5 3 

2 2 ' 

4 4 


= A T , the matrix is symmetric. 


^ A 7 , the matrix is not symmetric. 


^ A T , the matrix is not symmetric. 


4 . Since A = 


5 . Since A = 


0 8 3 

8 0-2 
3-2 0 

-6 2 0 
0-6 2 
0 0-6 


= A , the matrix is symmetric. 


^ A 7 , the matrix is not symmetric. 


6. Since A is not a square matrix A ^ A 7 and the matrix is not symmetric. 


379 
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7. Let P = 


.6 


-.6 


and compute that 


P T P = 


".6 

. 8 " 

".6 

. 8 " 


"1 

0 " 

_- 8 

-.6 

.8 

-.6 


0 

1 


= U 


Since P is a square matrix, P is orthogonal and P 1 = P 1 = 


-.6 


8. Let P = 


'l/V2 -1/V2 
1/V2 1/V2 


, and compute that 




1 /V 2 I/V 2 " 

"l/V 2 -I/V 2 " 


"1 0" 

_— 1/ V 2 1/V2 

1/V2 1/V2 


0 1 


= /, 


Since P is a square matrix, P is orthogonal and P 1 = P 1 = 


1 /V 2 I/V 2 " 
-1/V2 1/V2 


9. Let P = 


-5 2 

2 5 


and compute that 


P T P = 


'-5 

2" 

'-5 

2" 


"29 

0" 

2 

5_ 

2 

5_ 


_ 0 

29 


* u 


Thus P is not orthogonal. 

, and compute that 


10. Let P = 


-12 2 
2-12 
2 2-1 


P T P = 


"-1 

2 

2" 

'-1 

2 

2" 


"9 

0 

0 " 

2 

-1 

2 

2 

-1 

2 

= 

0 

9 

0 

2 

2 

-1 

2 

2 

-1 


0 

0 

9 


* h 


Thus P is not orthogonal. 


11. Let P = 


2/3 

2/3 

0 

1/V5 

<75/3 

-4/V45 


1/3' 

-2/V5 

-2/V45 


and compute that 



"2/3 

0 

<75/ 3 " 

2/3 

2/3 

1/3" 

- 

P r P = 

2/3 

1/V5 

- 4 /V 45 

0 

1/V5 

- 2/ <75 

= 


1/3 

-2/V5 

- 2 /V 45 

V5/3 

-4/V45 

-2/>/45 

. 
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Since P is a square matrix, P is orthogonal and P = P = 2/3 


2/3 

0 

V5/3 

2/3 

1/yfS 

-4/V45 

1/3 

-2/V5 

-2/V45 


12. Let P = 


.5 .5 -.5 -.5 

-.5 .5 -.5 .5 

.5 .5 .5 .5 

-.5 .5 .5 -.5 


and compute that 


P T P = 


.5 -.5 .5 -.5 

.5 .5 .5 .5 

-.5 -.5 .5 .5 

-.5 .5 .5 -.5 


.5 .5 -.5 -.5 

-.5 .5 -.5 .5 

.5 .5 .5 .5 

-.5 .5 .5 -.5 


10 0 0 
0 10 0 
0 0 10 
0 0 0 1 


Since P is a square matrix, P is orthogonal and P 1 =P T = 


.5 -.5 .5 -.5 

.5 .5 .5 .5 

.5 -.5 .5 .5 

-.5 .5 .5 -.5 


3 1 

13. Let A = i . Then the characteristic polynomial of A is (3-Zi) 2 -1 = X 2 —€k + 8 = (A, — 4)(A, — 2), so 


the eigenvalues of A are 4 and 2. For A = 4, one computes that a basis for the eigenspace is , which 

fi/VTI „ r-r 

can be normalized to get u, = . For A = 2, one computes that a basis for the eigenspace is , 

1/V2 L l . 


which can be normalized to get u, = 


-1/V2 

1/V2 


, , fl/ V2 -I/V2I [4 0 

P= u, u 9 = andD = 

L J 1/V2 1/V2 L° 2 


Then P orthogonally diagonalizes A, and A = PDF 1 . 


14. Let A= $ ^ . Then the characteristic polynomial of A is (1 — 2e) 2 - 25 = A. 2 - 2X — 24 = (k -6)(k + 4), 

so the eigenvalues of A are 6 and -4. For X = 6, one computes that a basis for the eigenspace is , 

[1/V2I 

which can be normalized to get u, = . For A = -4, one computes that a basis for the eigenspace is 

Ll/V2j 

"-ll [-1/V2" 

, which can be normalized to get u, = 

! J 1/V2 
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p =Wi u 2 ] = 


-1/ V2I r 6 0 

and D = 

1/V2 L° - 4 


Then P orthogonally diagonalizes A, and A - PDP . 


16-4 

15. Let A = . Then the characteristic polynomial of A is (16 — A,)(l — A,) — 16 = k 2 — 17A, = (A, — 17)A, . 

„ T- 4 ’ 

so the eigenvalues of A are 17 and 0. For A = 17, one computes that a basis for the eigenspace is , 

[-4/717] 

which can be normalized to get u, = . For A = 0, one computes that a basis for the eigenspace 

[ 1/Vl7j 

. "1] [l/Vl7] 

is , which can be normalized to get u, = . Let 

_4J 4/ylrf 


r n [-4/TL7 l/Vn] [17 0 

P= u, u, = , , andD = 

1/Tl7 4/TL7 L 0 0 


Then P orthogonally diagonalizes A, and A = PDP 


-7 24 

16 . Let rt = ^ ^ . Then the characteristic polynomial of A is (-7- X)(7-X)- 576 = A, 2 -625 = 

(k - 25)(A + 25) , so the eigenvalues of A are 25 and -25. For A = 25, one computes that a basis for the 
"3] [3/5] 

eigenspace is ^ , which can be normalized to get Uj = . For k = -25, one computes that a basis 

[-4] [-4/5] 

for the eigenspace is , which can be normalized to get u 2 = .Let 


, , [3/5 -4/5] [25 0 

P= u, u, = andD = 

L J 4/5 3/5 0 -25 


Then P orthogonally diagonalizes A, and A = PDP 1 . 


1 1 3 


17 . Let A = 1 3 1 . The eigenvalues of A are 5, 2, and -2. For k = 5, one computes that a basis for the 

3 1 1 


eigenspace is 1 , which can be normalized to get Uj = 1/V3 . For A = 2, one computes that a basis for 

_1_ 1/73 
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the eigenspace is -2 , which can be normalized to get u, = —2/\[6 . For X = -2, one computes that a 

lj 1/V6 

"-ll \-\l4l 

basis for the eigenspace is 0 , which can be normalized to get u 3 = 0 . Let 


1/V6 

-1/V2" 

"5 

0 

0" 

2/V6 

0 

and D = 0 

2 

0 

1 / -s/6 

lV2 

0 

0 

-2 


Then P orthogonally diagonalizes A, and A = PDP . 

" -2 -36 0‘ 

18 . Let A = -36 -23 0 . The eigenvalues of A are 25, 3, and -50. For X = 25, one computes that a basis 

0 0 3 

4] [-4/5' 

for the eigenspace is 3 , which can be normalized to get U[ = 3/5 . For X = 3, one computes that a 


basis for the eigenspace is 0 , which is of length 1, so u 2 = 0 . For X = -50, one computes that a 


basis for the eigenspace is 4 , which can be normalized to get u 3 = 4/5 . Let 


-4/5 0 3/5 


25 0 0 


P = [uj u 2 u 3 ] = 3/5 0 4/5 andD= 0 3 0 


0 1 0 


0 0 -50 


Then P orthogonally diagonalizes A, and A = PDP . 

'3 -2 4 

19 . Let A = —2 6 2 . The eigenvalues of A are 7 and -2. For X = 7, one computes that a basis for the 

4 2 3 

M r 

eigenspace is < 2 , 0 >. This basis may be converted via orthogonal projection to an orthogonal 

0 1 
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"-1" 


" 4 


basis for the eigenspace: < 


2 

9 

2 




0 


5 



. These vectors can be normalized to get Uj = 


-1/V5 

2/V5 

0 



4/V45 


~-2" 

u 2 = 

2/V45 

5/V45 

. For A = -2, one computes that a basis for the eigenspace is 

-1 

2 


, which can be 


normalized to get u 3 = 


-2/3 

-1/3 

2/3 


Let 


P = Wl U 2 U 3 ] = 


-l/y/5 

4/V45 

-2/3 


"7 

0 

0 " 

2/V5 

2/V45 

-1/3 

and D = 

0 

7 

0 

0 

5/V45 

2/3 


0 

0 

-2 


Then P orthogonally diagonalizes A, and A = PDP 1 . 


20 . Let A = 


7-4 4 

-4 5 0 

4 0 9 

' 2 ' 

the eigenspace is | -1 


The eigenvalues of^4 are 13, 7, and 1. For A = 13, one computes that a basis for 


which can be normalized to get u, = 


2/3 

-1/3 


Lcl 

"-1" 

L 2/3 J 

-1/3“ 

basis for the eigenspace is 

2 

, which can be nonnalized to get u 2 = 

2/3 


2 


2/3 



“ 2“ 


" 2/3“ 

that a basis for the eigenspace is 

2 

, which can be nonnalized to get u 3 = 

2/3 


-1 


-1/3 


. For A, = 7, one computes that a 


. For A = 1 , one computes 


. Let 


“ 2/3 

-1/3 

2/3“ 


“13 

0 

0“ 

-1/3 

2/3 

2/3 

and D = 

0 

7 

0 

2/3 

2/3 

-1/3 


0 

0 

1 


Then P orthogonally diagonalizes A, and A = PDP 1 . 
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21. Let A = 


4 13 1 

14 13 

3 14 1 

13 14 

Y 


. The eigenvalues of A are 9, 5, and 1. For X = 9, one computes that a basis for 


the eigenspace is 


, which can be normalized to get u, = 


1 / 2 ' 

1/2 

1/2 

1/2 


. For X = 5, one computes that a basis 


for the eigenspace is 


"-1" 


"-1/2" 

1 

, which can be normalized to get u 2 = 

1/2 

-1 

-1/2 

1 


!/2_ 


( r-n r <n l 



. For X = 1, one computes that a 


basis for the eigenspace is 


-1 

0 

1 


. This basis is an orthogonal basis for the eigenspace, and these 


vectors can be normalized to get u 3 = 


"-1/V2" 


0" 

0 


-1/V2 

1/V2 

, U 4 = 

0 

0 


Vyf : 2_ 


. Let 



"1/2 

-1/2 

-1/V2 

0 


"9 

0 

0 

0" 

P = [ Ui u 2 u 3 u 4 ] = 

1/2 

1/2 

0 

1/V2 

-1/V2 

andD = 

0 

5 

0 

0 

1/2 

-1/2 

0 


0 

0 

1 

0 


1/2 

1/2 

0 

1/V2 


0 

0 

0 

1 


Then P orthogonally diagonalizes A, and A = PDF 


-l 


22. Let A = 


2 0 0 0 
0 10 1 
0 0 2 0 
0 10 1 


. The eigenvalues of A are 2 and 0. For X = 2, one computes that a basis for the 


eigenspace is 



T 


" 0 " 


' 0 " 



0 


1 


0 



0 

9 

0 

9 

1 



0 


1 


0 



This basis is an orthogonal basis for the eigenspace, and these vectors 



386 CHAPTER 7 • Symmetric Matrices and Quadratic Forms 


0 1 /V 2 0 

can be normalized to get u 3 = , u 2 = , and u 3 = ^ . For A = 0, one computes that a basis for 


the eigenspace is , which can be normalized to get u 4 = 


-1/V2 


P = [u l u 2 u 3 u 4 ] = 


1 00 0 l “2 0 0 0 “ 

0 1/V2 0 -l/y/2 0 2 0 0 

and D = 

0 0 1 0 0 0 2 0 

0 l/y/2 0 1/V2 _0 0 0 0 


Then P orthogonally diagonalizes A, and A = POP 1 . 
"3 1 f 

23. Let A= 1 3 1 . Since each row of A sums to 5, 

1 1 3 


13 1 11 [5] IT 
A 1 = 1 3 1 1 = 5 =5 1 

1 113 1 5 1 


and 5 is an eigenvalue of A. The eigenvector 1 may be normalized to get Uj = 1/V3 . One may also 

A 1/V3 

compute that 

“-11 [3 1 iir-ii [-21 r-r 

A 1=13 1 1 = 2 =2 1 

0 1 1 3 0 0 0 


so 1 is an eigenvector of A with associated eigenvalue X = 2. For X = 2, one computes that a basis for 


-1 r-11 

the eigenspace is < 1 , -1 >. This basis is an orthogonal basis for the eigenspace, and these vectors 

L 0 J L 2 J 

”- 1 / V2I T- 1 /V 6 

can be normalized to get u 2 = l/>/2 and u 3 = -1/ 4~6\. 

0 2/V6 



7.1 • Solutions 


387 


Let 


"l /yl3 

-1/V2 

-1/V6" 


“5 

0 

0 " 

1/V3 

1/V2 

-1/V6 

andD = 

0 

2 

0 

1 /y/3 

0 

2/V6 


0 

0 

2 


Then P orthogonally diagonalizes A, and A = PDF 1 . 


24. Let A = 


5 

-4 

-2 


-4 

5 

2 


-2 

2 

2 


One may compute that 



"-2" 


"-20“ 


"-2“ 

A 

2 

= 

20 

= 10 

2 


1 


10 


1 


SO V! = 


-2 

2 

1 


is an eigenvector of A with associated eigenvalue L, =10. Likewise one may compute that 



T 


"1" 


T 

A 

1 

= 

1 

= 1 

1 


0 


0 


0 


so 


is an eigenvector of A with associated eigenvalue X 2 = 1 . For X 2 = 1 , one computes that a basis 


. This basis may be converted via orthogonal projection to an 




“1“ 


“1“ 


for the eigenspace is < 


1 

9 

0 




0 


2 



orthogonal basis for the eigenspace: {v 2 ,v 3 } = 


normalized to get the vectors u, = 



T 


r 



1 

9 

-1 



0 


4 



"- 2 / 3 " 


"l/V2" 


’l/Vl8’ 

2/3 

» U 2 = 

1/V2 

, and u 3 = 

1/Vl8 

1/3 


0 


4 / yflS 


. The eigenvectors Vj , v 2 , and v 3 may be 


. Let 


-2/3 

1/V2 

1/Vl8 


“10 0 0“ 

2/3 

1/V2 

-1/Vl8 

andD = 

0 1 0 

1/3 

0 

4/Vl8 


0 0 1 


Then P orthogonally diagonalizes A, and A = PDF 1 . 
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25. a. True. See Theorem 2 and the paragraph preceding the theorem. 

b. True. This is a particular case of the statement in Theorem 1, where u and v are nonzero. 

c. False. There are n real eigenvalues (Theorem 3), but they need not be distinct (Example 3). 

d. False. See the paragraph following formula (2), in which each u is a unit vector. 

26. a. True. See Theorem 2. 

b. True. See the displayed equation in the paragraph before Theorem 2. 

c. False. An orthogonal matrix can be symmetric (and hence orthogonally diagonalizable), but not every 
orthogonal matrix is symmetric. See the matrix P in Example 2. 

d. True. See Theorem 3(b). 

27. Since A is symmetric, (B T AB) T = B T A T B n =B r AB, and B T AB is symmetric. Applying this result with 
A - I gives B 1 B is symmetric. Finally, (BB 1 ) T =B TT B 1 = BB T , so BB 1 is symmetric. 

28. Let A be an n x n symmetric matrix. Then 

(Ax) • y = (Ax) t y = x T A r y = x T Ay = x ■ (Ay) 
since A r = A. 

29. Since A is orthogonally diagonalizable, A = PDP 1 , where P is orthogonal and D is diagonal. Since A is 
invertible, A~ l =(PDP l )~ l =PD~ l P l . Notice that D l is a diagonal matrix, so A~ l is orthogonally 
diagonalizable. 

30. If A and B are orthogonally diagonalizable, then A and B are symmetric by Theorem 2. If AB = BA, 
then (AB) r = (BA) 1 = A 1 B 1 = AB . So AB is symmetric and hence is orthogonally diagonalizable by 
Theorem 2. 

31. The Diagonalization Theorem of Section 5.3 says that the columns of P are linearly independent 
eigenvectors corresponding to the eigenvalues of A listed on the diagonal of D. So P has exactly k 
columns of eigenvectors corresponding to X. These k columns form a basis for the eigenspace. 

32. If A = PRP~\ then P~ l AP = R. Since P is orthogonal, R = P T AP . Hence R T =(P T AP) T =P T A r P TT = 

P T AP = R, which shows that R is symmetric. Since R is also upper triangular, its entries above the 
diagonal must be zeros to match the zeros below the diagonal. Thus R is a diagonal matrix. 

33. It is previously been found that A is orthogonally diagonalized by P, where 

’-1/V2 -1/V6 1/V3I r 8 0 o~ 

E = [u 1 u 2 u 3 ] = 1/V2 -1/V6 1/V3 and D= 0 6 0 

0 2/V6 1/J3 Lo 0 3_ 

Thus the spectral decomposition of A is 

1 'J 1 1 y 1 y ' y 1 

A = A. 1 u 1 u 1 +A, 2 u 2 u 2 +^3113113 =811,11! +6u 2 u 2 + 3 u 3 u 3 



1/6 

1/6 

-2/6" 


"1/3 

1/3 

1/3" 

+ 6 

1/6 

1/6 

-2/6 

+ 3 

1/3 

1/3 

1/3 


-2/6 

-2/6 

4/6 


1/3 

1/3 

1/3 


1/2 - 1/2 0 

1/2 1/2 0 

0 0 0 
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34. It is previously been found that A is orthogonally diagonalized by P, where 


’ 1 /V 2 

- 1 /V 18 

-2/3 


"7 

0 

0 " 

0 

4/V18 

-1/3 

and D = 

0 

7 

0 

1/V2 

1/V18 

2/3 


0 

0 

-2 


Thus the spectral decomposition of A is 
A = A.jU,!!, 7 + ^ 2 u 2 u 2 r + X, 3 u 3 u 3 r = TujUj 7 + 7u 2 u 2 r - 2u 3 u 3 r 


"1/2 

0 

1/2' 


1/18 

-4/18 

-1/18" 


" 4/9 

2/9 

-4/9" 

0 

0 

0 

+ 7 

-4/18 

16/18 

4/18 

-2 

2/9 

1/9 

-2/9 

1/2 

0 

1/2 


-1/18 

4/18 

1/18 


-4/9 

-2/9 

4/9 


35. a. Given x in ", bx = (uu r )x = u(u r x) = (u 7 x)u, because u r x is a scalar. So Bx = (x • u)u. Since u is a 

unit vector, Bx is the orthogonal projection of x onto u. 

b. Since B l = (uu 7 ) 7 = u 77 u 7 = uu 7 =B , B is a symmetric matrix. Also, 

B 2 =(uu r )(uu 7 ) = u(u 7 u)u r =uu 7 =B because u 7 u = l. 

c. Since u 7 u = 1 , 5u = (uu r )u = u(u 7 u) = u(l) = u , so u is an eigenvector of B with corresponding 
eigenvalue 1. 

36. Given any y in ", let y = By and z = y — y . Suppose that B l = B and B 2 = B . Then B 1 B = BB = B. 

a. Since z • y = (y - y) • (By) = y • (By) - y ■ (By) = y T By - (By) 1 By = y T By - y 7 B T By = 0 , z is 
orthogonal to y. 

b. Any vector in W= Col B has the form Bu for some u. Noting that B is symmetric, Exercise 28 gives 

( y -y ) • (Bn) = [B(y -y )] • u = [Sy - BBy] • u = 0 

since Br = B. So y -y is in W L , and the decomposition y=y + (y~y) expresses y as the sum of a 

vector in W and a vector in W 1 . By the Orthogonal Decomposition Theorem in Section 6.3, this 
decomposition is unique, and so y must be proj ((/ y. 


37. [M] Let A = 


5 

2 

9 

-6 


2 

5 

-6 

9 


9 

-6 

5 

2 


-6 

9 

2 

5 


The eigenvalues of A are 18, 10, 4, and-12. For?i= 18, one 


computes that a basis for the eigenspace is 


"-1" 


1/2" 

1 

, which can be normalized to get iq = 

1/2 

-1 

-1/2 

1 


!/2_ 


T 


"1/2" 

1 

, which can be normalized to get u 2 = 

1/2 

1 

1/2 

1 


\! 2_ 


X = 1 0, one computes that a basis for the eigenspace is 
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For A = 4, one computes that a basis for the eigenspace is , which can be normalized to get 


-L / z- > > J. 

u 3 = . For A = -12, one computes that a basis for the eigenspace is , which can be 


1/2 - 1/2 1/2 1/2 1/2 

- 1/2 r n 1/2 1/2 1/2 - 1/2 

normalized to get u 4 = . Let P= u, u, u 3 u 4 = and 

4 - 1/2 L 1 2 3 4J - 1/2 1/2 - 1/2 - 1/2 


1/2 1/2 - 1/2 1/2 


18 0 0 0 


0 10 0 0 

D = ^ 0 4 0 Then P orthogonally diagonalizes A, and A = PDP . 

0 0 0 -12 


38. [M] Let A = 


.38 

-.18 

-.06 

-.04 

-.18 

.59 

-.04 

.12 

-.06 

-.04 

.47 

-.12 

-.04 

.12 

-.12 

.41 


. The eigenvalues of A are .25, .30, .55, and .75. For A = .25, 


2 .4 

one computes that a basis for the eigenspace is , which can be normalized to get u, = For 


A = .30, one computes that a basis for the eigenspace is , which can be normalized to get 


.~r i 

u 2 = . For A = .55, one computes that a basis for the eigenspace is , which can be normalized 


to get u 3 = . For A = .75, one computes that a basis for the eigenspace is , which can be 
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normalized to get u 4 = 


'-.4' 



".8 

-.2 

.4 

-.4' 

.8 

. Let i 3 = [u. 

u 2 U 3 u 4 ] = 

.4 

-.4 

-.2 

.8 

-.2 

.4 

.4 

-.8 

-.2 

.4 



.2 

.8 

.4 

.4 


and 


D = 


.25 0 0 0 

0 .30 0 0 

0 0 .55 0 

0 0 0 .75 


. Then P orthogonally diagonalizes A, and A = PDP 1 . 


39. [M] Let A = 


.31 

.58 

.08 

.44 

.58 

-.56 

.44 

-.58 

.08 

.44 

.19 

-.08 

.44 

-.58 

-.08 

.31 


. The eigenvalues of A are .75, 0, and -1.25. For A = .75, one 


computes that a basis for the eigenspace is 



T 


"3" 



0 


2 



0 

5 

2 



1 


0 



. This basis may be converted via orthogonal 


projection to the orthogonal basis 


>. These vectors can be normalized to get u, = 


u. = 


" 3/^50~ 

IL1JL-3JJ 

'-2' 

4/V50 

. For A = 0, one computes that a basis for the eigenspace is 

-1 

4/>/50 

4 

_-3/a/50_ 


2 


1/V2’ 

0 

0 

1/V2 


which can be 


normalized to get u 3 = 


“-.4‘ 


“-2" 

-.2 

. For A = -1.25, one computes that a basis for the eigenspace is 

4 

.8 

-1 

.4 


2 


which can be normalized to get u 4 = 


-.4 

.8 

-.2 

.4 


Let P = [uj u 2 u 3 u 4 ] = 


"l/V2 

3/y[50 

-.4 

-.4 


".75 

0 

0 

0" 

0 

4/V50 

-.2 

.8 

and D = 

0 

.75 

0 

0 

0 

4/-\/50 

.8 

-.2 


0 

0 

0 

0 

1/V2 

-3/V50 

.4 

.4 


0 

0 

0 

-1.25 


Then P 


orthogonally diagonalizes A, and A = PDP 1 . 
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"10 

2 

2 

-6 


2 

10 

2 

-6 

40. [M] Let A = 

2 

2 

10 

-6 


-6 

-6 

-6 

26 


9 
9 
9 
9 

9 -19 


. The eigenvalues of A are 8, 32, -28, and 17. For X = 8, one 


computes that a basis for the eigenspace is 



' 1 ' 


-f 



-1 


0 



0 

9 

1 



0 


0 



0 


0 



Thi s basis may be converted via orthogonal 


projection to the orthogonal basis 



' 1 ' 


' 1 " 



-1 


1 



0 

9 

-2 



0 


0 



0 


0 



. These vectors can be normalized to get 


u, = 


1/V2" 


1/V6 - 


f 

-1/V2 


1/V6 


1 

0 

» U 2 = 

— 2/ -s/6 

. For X = 32, one computes that a basis for the eigenspace is 

1 

0 


0 


-3 

0 


0 


0 


which 


can be normalized to get u 3 = 


1/VT2 

1/Vl2 

1/VT2 

-3/Vl2 

0 


. For X = -28, one computes that a basis for the eigenspace is 


f 


1/V20" 

1 


1 /V20 

1 

, which can be normalized to get u 4 = 

1/V20 

1 


1/V20 

_-4_ 


_-4/>/20 


17, one computes that a basis for the 


eigenspace is 


T 


"l/>/5" 

1 


l/yf5 

1 

, which can be normalized to get u 5 = 

l/y/5 

1 


l/yfs 

1 


l/y/5 
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Let P = [uj U 2 


D = 


8 0 
0 8 
0 0 
0 0 
0 0 


0 

0 

32 

0 

0 


IL 


0 

0 

0 

-28 

0 



1 /y/2 

1/V6 

1 /VT 2 

1 /V 20 

1 /V 5 


-1/V2 

Vy/6 

1 /V 12 

1 /V 20 

1 /V 5 

u 5 ] = 

0 

-2/V6 

1 /V 12 

1 /V 20 

l/yfs 


0 

0 

- 3 /V 12 

1 /V 20 

1 /V 5 


0 

0 

0 

- 4 /V 20 

l/y/5 


0 

0 

0 

0 

17 


Then P orthogonally diagonalizes A, and A = POP 


and 


7.2 SOLUTIONS 

Notes: This section can provide a good conclusion to the course, because the mathematics here is widely 
used in applications. For instance, Exercises 23 and 24 can be used to develop the second derivative test for 
functions of two variables. Flowever, if time permits, some interesting applications still lie ahead. Theorem 4 
is used to prove Theorem 6 in Section 7.3, which in turn is used to develop the singular value decomposition. 


1. a. x T Ax = [x { 


x-,1 

“ 5 

1/3" 

Xj 

^ J 

1/3 

1 

- X 2 _ 


= 5xj + (2 / 3 )x 1 x 2 + *2 



"6" 

b. When x = 

1 


T 

c. When x = 

3 


x t Ax = 5(6) 2 + (2/3)(6)(l) + (l) 2 =185. 
x T Ax = 5(1) 2 + (2/3)(l)(3) + (3) 2 = 16. 



"4 

3 

0" 

Xi 

2. a. x T Ax = \x x x 2 x 3 ] 

3 

2 

1 

x 2 


0 

1 

1 

_ X 3 . 


b. When x = 


2 

-1 

5 


= 4x 2 + 2xl + x 3 + 6 xjX 2 + 2x 2 x 3 


, x 1 Ax = 4(2) / + 2(-l) 2 + (5) 2 + 6(2)(— 1) + 2(-l)(5) = 21. 


c. When x = 


1/ V3 
1/V3 
l/x/3 


r Jx = 4(l/V3) 2 + 2(l/V3) 2 + (l/V3) 2 +6(l/V3)(l/V3) + 2(l/V3)(l/V3) = 5. 


3 . 


a. The matrix of the quadratic form is 


10 

-3 


-3 

-3 


b. The matrix of the quadratic form is 



3/2 

0 ‘ 
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4. a. The matrix of the quadratic form is 
b. The matrix of the quadratic form is 


5. a. The matrix of the quadratic form is 


b. The matrix of the quadratic form is 


6. a. The matrix of the quadratic form is 


b. The matrix of the quadratic form is 


20 

15/2" 

15/2 

— !0 

0 

1/2" 


\n 

0 


8 

-3 

2" 

-3 

7 

-1 

2 

-1 

-3 

0 

2 

3" 

2 

0 - 

-4 . 

3 - 

4 

0 

5 

5/ 

2 

5/2 

- 

1 

- 3/2 


0 

0 

-2 

0" 

-2 

0 

2 . 

0 

2 

1 


7. The matrix of the quadratic form is A = 


1 5 
5 1 


. The eigenvalues of A are 6 and -4. An eigenvector for 


X = 6 is 


which may be normalized to Uj = 


1/V2 

1/V2 


. An eigenvector for X = -4 is 


-1 

1 


be normalized to u, = 


-I/V 2 " 

1/V2 


. Then A = PDP 1 , where P = [uj u 2 ] = 


1/V2 -1/V2 
1/V2 1/V2 


which may 


and 


D = 


6 0 
0 -4 


. The desired change of variable is x = Py, and the new quadratic form is 


x' As = (Py) J A(Py) = y T P T APy = y'Dy = 6y[ - 4yi 


8 . The matrix of the quadratic form is A = 


9-4 4 

-4 7 0 



"-2" 


4 0 llj 


"-2/3" 

eigenvector for X = 3 is 

-2 

1 

, which may be normalized to U[ = 

-2/3 

1/3 


. The eigenvalues of A are 3, 9, and 15. An 


An eigenvector for X = 9 is 


"-1" 


"-1/3" 


“ 2" 

2 

2 

, which may be normalized to u, = 

2/3 

2/3 

. An eigenvector for X = 1 5 is 

-1 

2 


, which may be 
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2/3 -2/3 -1/3 2/3 

normalized to u 3 = -1/3 . Then A = PDP~ X , where P = [uj u 2 u 3 ]= -2/3 2/3 -1/3 and 

2/3J [ 1/3 2/3 2/3 

“3 0 0" 

D = 0 9 0 . The desired change of variable is x = Py, and the new quadratic form is 

0 0 15 

x r Ax = (Pyf A(Py ) = y T P T APy = y T Dy = 3 y 2 + 9 y\ + 1 5 y\ 


9 . The matrix of the quadratic form is A = 


3 -2 

-2 6 


form is positive definite. An eigenvector for A. = 7 is , which may be normalized to u, = 


. The eigenvalues of A are 7 and 2, so the quadratic 

"-1"| [-1/ V5 

is , which may be normalized to u, = 

_ 2 J 2/yj5 


An eigenvector for X = 2 is , which may be normalized to u 2 = 


2/V5 

1/V5 


. Then A = PDP 1 , where 


, , "-1/V5 2/V5 

P = u 2 ] = 

2/V5 1/V5 

new quadratic form is 


and D = 


The desired change of variable is x = Py, and the 


x r Ax = (Pyf A(Py) = y T P T APy = y r Dy = 7yf + 2y“ 


10 . The matrix of the quadratic form is A = 


9 -4 

-4 3 


. The eigenvalues of A are 1 1 and 1, so the quadratic 

" 2l 2/V5 

. is , which may be normalized to u, = 

-1/yfS 


form is positive definite. An eigenvector for A. = 1 1 is , which may be normalized to u, = 

„ rn r 1 /V 5 I 

An eigenvector for A = 1 is , which may be normalized to u 2 = . Then A = PDP 

_ 2 J 2/V5 


r 3 2/V5 1/V5 

^=u, u 2 ] = 

-l/y[5 2/ -s/5 

new quadratic form is 


and D = 


11 0 
0 1 


ralized to u, = . Then A = PDP , where 

~ 21 \l~5 _ 

. The desired change of variable is x = Py, and the 


x r Ax = (Pyf A(Py) = y T P T APy = y T Dy = 1 1 yf + y 2 2 


11 . The matrix of the quadratic form is A = 


. The eigenvalues of A are 7 and -3, so the quadratic 


form is indefinite. An eigenvector for X = 7 is , which may be normalized to iq = 


eigenvector for X = -3 is , which may be normalized to u 2 = 


Then A = PDP ~ l . 
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[1/V2 -1/V2 

where i 3 = lu 1 u 2 l = 

‘ ^ \\i4i 1 /V 2 

and the new quadratic form is 


and D = 


7 0 

0 -3 


. The desired change of variable is x = Py, 


x r Ax = (Py f A(Py) = y T P T APy = y T Dy = 7y 2 - 3y 2 


12. The matrix of the quadratic form is A = 


-5 2 

2 -2 


form is negative definite. An eigenvector for \ = -1 is , which may be normalized to u, = 


. The eigenvalues of A are -1 and -6, so the quadratic 

f ll [i/VT 

1 is , which may be normalized to u, = 

_ 2 J 2/V5 


An eigenvector for \ = -6 is , which may be normalized to u 2 = 


-2/yf5 

1/V5 


. Then A = PDP 


, , I" l/y/5 -2/4$ 

where P= Uj u, = 

L 2/45 1/45 

and the new quadratic form is 


and D = 


-1 0 
0 -6 


. The desired change of variable is x = Py, 


x t Ax = (Py) T A(Py) = y T P T APy = y r Dy = -y? - 6y 2 2 


13. The matrix of the quadratic form is A = 


1 -3 

-3 9 


. The eigenvalues of A are 1 0 and 0, so the quadratic 


form is positive semidefmite. An eigenvector for 1 0 is , which may be normalized to 


1 /VT 0 

-3/VTo 


. An eigenvector for X = 0 is , which may be normalized to u 2 = 


3 /4io 
1 / V 10 


. Then 


r n [ i/4io 3/Vio 

A = PDP , where P = [uj u 2 1 = 

1-3/410 1 /V 10 

variable is x = Py, and the new quadratic form is 

x r Ax = (Py) T A(Py) = y T P T APy = y T Dy = 1 0 y\ 


and D = 


10 0 


. The desired change of 


14. The matrix of the quadratic form is A = ^ ^ . The eigenvalues of A are 9 and -1, so the quadratic 

„ [31 \3/M 

form is indefinite. An eigenvector for A = 9 is , which may be normalized to 1 ^ = . An 

1 / V 10 


eigenvector for X = -1 is , which may be normalized to u 2 = 


- 1 /VT 0 

3/VlO 


. Then A = PDP 1 , where 


, , f3/VTo -1/ V10 

p = u, u 2 = 

1/VlO 3/V10 
new quadratic form is 


and D = 


9 0 

0 -1 


The desired change of variable is x = Py, and the 


x T Ax = (Py) T A(Py) = y T P T APy = y r Dy = 9 y 2 - y 2 
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15. [M] The matrix of the quadratic form is A = 


-2 

2 

2 

2 


2 2 
-6 0 
0 -9 

0 3 


2 

0 

3 

-9 


The eigenvalues of A are 0, -6, -8, 


and -12, so the quadratic form is negative semidefmite. The corresponding eigenvectors may be 
computed: 


“3“ 


" 0“ 


"-1" 


“ 0" 

1 

, A, = — 6 : 

-2 

00 

1 

II 

1 

,X = -12: 

0 

1 

1 

1 

-1 

1 


1 


1 


1 


These eigenvectors may be normalized to form the columns of P, and A = PDP 1 , where 


3/Vl2 

0 

-1/2 

0 


"0 

0 

0 

0" 

1/ Vl2 

-2/V6 

1/2 

0 

and D = 

0 

-6 

0 

0 

1/y/U 

1/V6 

1/2 

-1/V2 


0 

0 

-8 

0 

1/VI2 

1/V6 

1/2 

1/V2_ 


0 

0 

0 

-12 


The desired change of variable is x = Py, and the new quadratic form is 

T / n„,\T A / n_\ T 7 ~iT a d_. S 


16. [M] The matrix of the quadratic form is A = 


l y=- 

o \ 

Ki to 

1 

8J3- 

12 V4 

4 

3/2 

0 

-2 

3/2 

4 

2 

0 

0 

2 

4 

3/2 

-2 

0 

3/2 

4 


. The eigenvalues of A are 1 3/2 


and 3/2, so the quadratic form is positive definite. The corresponding eigenvectors may be computed: 




-4' 


"3" 




' 4' 


" 3" 




0 


5 




0 


-5 


X. = 13/2 : • 


3 

? 

4 


>, X = 3/2 :■ 


-3 

9 

4 




5 


0 




_ 5_ 


0 



Each set of eigenvectors above is already an orthogonal set, so they may be normalized to form the 
columns of P, and A = PDP _1 , where 


3/V50 

-4/V50 

3/V50 

4/V50 


“13/2 

0 

0 

0“ 

5/V50 

0 

-5/V50 

0 

and Z9 = 

0 

13/2 

0 

0 

4/V50 

3/V50 

4/V50 

-3/V50 

0 

0 

3/2 

0 

0 

5/>/50 

0 

5/V50 


0 

0 

0 

3/2_ 


The desired change of variable is x = Py, and the new quadratic form is 

x r Ax = (Pyf A(Py) = y T P T APy = y T Dy = y yf + y + 1 y 3 2 + |y 4 2 
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17. [M] The matrix of the quadratic form is A = 


1 

9/2 

0 

-6 

9/2 

1 

6 

0 

0 

6 

1 

9/2 

-6 

0 

9/2 

1 


. The eigenvalues of A are 1 7/2 


and -13/2, so the quadratic form is indefinite. The corresponding eigenvectors may be computed: 


X = IV2:\ 



-4' 


3" 




' 4 


' 3" 



0 


5 


-, k = -13/2:- 


0 


-5 



3 


4 



-3 


4 



5_ 


0 




_ 5_ 


0 



Each set of eigenvectors above is already an orthogonal set, so they may be normalized to form the 


columns of P, and A = PDF 1 , where 


P = 


3/V50 

-4/^50 

3/V50 

4/V50 


“17/2 

0 

0 

0“ 

5/V50 

0 

-5/V50 

0 

or »ri n 

0 

17/2 

0 

0 

4/V50 

3/^50 

4/V50 

-3/V50 

cinG LJ — 

0 

0 

-13/2 

0 

0 

5/>/50 

0 

5/V50 


0 

0 

0 

-13/2 


The desired change of variable is x = Py, and the new quadratic form is 

x T Ax = (Py) T A(Py) = y T P T APy = y T Dy= l l-yf+^-y* ~y\~y\ 


18. [M] The matrix of the quadratic form is A = 


11 

-6 

-6 

-6 

-6 

-1 

0 

0 

-6 

0 

0 

-1 

-6 

0 

-1 

0 


. The eigenvalues of A are 17, 1,-1, 


and -7, so the quadratic form is indefinite. The corresponding eigenvectors may be computed: 


X = 17: 


"-3“ 


“ 0“ 


“ 0“ 


Y 

1 

,k = l: 

0 

,k = -l: 

-2 

, X = -7 : 

l 

1 

-1 

1 

l 

1 


1 


1 


l 


These eigenvectors may be normalized to form the columns of P, and A = PDP 1 , where 


P = 


The desired change of variable is x = Py, and the new quadratic form is 
x T Ax = (Py) T A(Py) = y T P T APy = y r Dy = \7y\ + y 2 - y 2 - 7y 2 


"-3/VI2 

0 

0 

1/2" 


“17 

0 

0 

0“ 

1 / -Jll 

0 

2/V6 

1/2 


0 

1 

0 

0 

1 /V 12 

- 1 /V 2 

1/ \/6 

1/2 

cinG u — 

0 

0 

-1 

0 

1 /V 12 

1 /V 2 

1/V6 

l/2_ 


0 

0 

0 

-7_ 


19. Since 8 is larger than 5, the x 2 term should be as large as possible. Since x 2 + x 2 = 1 , the largest value 
that x 2 can take is 1 , and x, = 0 when x 2 = 1 . Thus the largest value the quadratic form can take when 
x r x = l is 5(0) + 8(1) = 8. 
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2 2 2 

20. Since 5 is larger in absolute value than -3, the jq term should be as large as possible. Since jq +x 2 = 1 , 
the largest value that x, can take is 1 , and x 2 = 0 when jq = 1 . Thus the largest value the quadratic form 
can take when x r x = l is 5(1) - 3(0) = 5. 

21. a. True. See the definition before Example 1, even though a nonsymmetric matrix could be used to 

compute values of a quadratic form. 

b. True. See the paragraph following Example 3. 

c. True. The columns of P in Theorem 4 are eigenvectors of A. See the Diagonalization Theorem in 
Section 5.3. 

d. False. Q(x) = 0 when x = 0. 

e. True. See Theorem 5(a). 

f. True. See the Numerical Note after Example 6. 

22. a. True. See the paragraph before Example 1. 

b. False. The matrix P must be orthogonal and make P T AP diagonal. See the paragraph before 
Example 4. 

c. False. There are also “degenerate” cases: a single point, two intersecting lines, or no points at all. See 
the subsection “A Geometric View of Principal Axes.” 

d. False. See the definition before Theorem 5. 

e. True. See Theorem 5(b). If x 7 Ax has only negative values for x ^ 0, then x 7 Ax is negative definite. 


23. The characteristic polynomial of A may be written in two ways: 

a - A b 
b d — A 


det (A -A J) = det 


= A, 2 - (a + d) A + ad -b 2 


and 


(A-Aj)(A-A 2 )- A — (Aj + A, 2 )A + AjA 7 

The coefficients in these polynomials may be equated to obtain A, + A 2 = a + d and AjA 2 = 
ad -b 2 = det A . 


24. If det A > 0, then by Exercise 23, AjA 2 > 0 , so that Aj and A, have the same sign; also, 
ad =det A + b 2 > 0 . 

a. If det A > 0 and a > 0, then d > 0 also, since ad > 0. By Exercise 23, Aj + A-, = a + d > 0 . Since Aj and 

A 2 have the same sign, they are both positive. So Q is positive definite by Theorem 5. 

b. If det A > 0 and a < 0, then d < 0 also, since ad > 0. By Exercise 23, A]+A-,=a + i/<0. Since Aj and 

A 2 have the same sign, they are both negative. So Q is negative definite by Theorem 5. 

c. If det A < 0, then by Exercise 23, AjA 2 < 0 . Thus Aj and A 2 have opposite signs. So Q is indefinite by 
Theorem 5. 


rp T T P 

25. Exercise 27 in Section 7.1 showed that B B is symmetric. Also x B Bx = (Bx) Bx = || Bx || > 0 , so the 
quadratic form is positive semidefinite, and the matrix B 1 B is positive semidefinite. Suppose that B is 
square and invertible. Then if x 7 B 1 Bx = 0, || Bx || = 0 and Bx = 0. Since B is invertible, x = 0. Thus if 
x ^ 0, x‘ B l Bx> 0 and B 1 B is positive definite. 
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26 . Let A = PDP t , where P T =P l . The eigenvalues of A are all positive: denote them X l ,...,X n . LetCbe 

the diagonal matrix with yj\, . on its diagonal. Then D = C 2 = C T C ,lfB = PCP T , then B is 

positive definite because its eigenvalues are the positive numbers on the diagonal of C. Also 

B t B = (PCP t ) t (PCP t ) = (P tt C t P t )(PCP t ) = PC t CP t =PDP t =A 
since P T P = I. 

27 . Since the eigenvalues of A and B are all positive, the quadratic forms x T A x and x 7 Bx are positive 
definite by Theorem 5. Let x ^ 0 . Then x T Ax > 0 and x 7 Bx > 0 , so x T (A + B)x = x T Ax + x T Bx > 0 , and 
the quadratic form x T (A + B)x is positive definite. Note that A + B is also a symmetric matrix. Thus by 
Theorem 5 all the eigenvalues of A + B must be positive. 

28 . The eigenvalues of A are all positive by Theorem 5. Since the eigenvalues of A~ l are the reciprocals of 
the eigenvalues of A (see Exercise 25 in Section 5.1), the eigenvalues of A ~ l are all positive. Note that 
A 1 is also a symmetric matrix. By Theorem 5, the quadratic form x T A 'x is positive definite. 


7.3 SOLUTIONS 


Notes: Theorem 6 is the main result needed in the next two sections. Theorem 7 is mentioned in Example 2 
of Section 7.4. Theorem 8 is needed at the very end of Section 7.5. The economic principles in Example 6 
may be familiar to students who have had a course in macroeconomics. 


1. The matrix of the quadratic form on the left is A = 


5 

2 

0 


2 

6 

-2 


0 

-2 

7 


The equality of the quadratic forms 


implies that the eigenvalues of A are 9, 6, and 3. An eigenvector may be calculated for each eigenvalue 
and normalized: 


1/3" 


'2/3' 


'-2/3' 

2/3 

,X = 6 : 

1/3 

,L = 3: 

2/3 

-2/3 


1/3 


1/3 


The desired change of variable is x = Py, where P = 


2 . The matrix of the quadratic form on the left is A = 


1/3 

2/3 

-2/3 

2/3 


1/3 

2/3 

-2/3 

2/3 

1/3 

1 

11 




2 

2 


. The equality of the quadratic forms 


implies that the eigenvalues of A are 5, 2, and 0. An eigenvector may be calculated for each eigenvalue 
and normalized: 


T /yl3~ 


"-2/76" 


0" 

1/73 

,X = 2: 

1/76 

,L = 0: 

-1/72 

1/73 


1/76 


1/72 


L = 5: 
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The desired change of variable is x = Py, where 


1/V3 

-2/ a/6 

0 

1/V3 

1/V6 

-1/V2 

1/V3 

1/V6 

1/V2 


3. (a) By Theorem 6, the maximum value of x T Ax subject to the constraint x 7 x = l is the greatest 
eigenvalue X,j of A. By Exercise 1, X, =9. 

(b) By Theorem 6, the maximum value of x T Ax subject to the constraint x 7 x = 1 occurs at a unit 


eigenvector u corresponding to the greatest eigenvalue Aj of A. By Exercise 1, u = ± 


1/3 

2/3 

-2/3 


(c) By Theorem 7, the maximum value of x T Ax subject to the constraints x T x = 1 and x 7 u = 0 is the 
second greatest eigenvalue A 2 of A. By Exercise 1, A, =6. 

4. (a) By Theorem 6, the maximum value of x T Ax subject to the constraint x 7 x = 1 is the greatest 
eigenvalue A[ of A. By Exercise 2, Aj=5. 

(b) By Theorem 6, the maximum value of x T Ax subject to the constraint x 7 x = 1 occurs at a unit 


eigenvector u corresponding to the greatest eigenvalue A } of A. By Exercise 2, u = ± 


l/x/3 
1 /V3 
l/x/3 


(c) By Theorem 7, the maximum value of x T Ax subject to the constraints x r x = 1 and x 7 u = 0 is the 
second greatest eigenvalue A 2 of A. By Exercise 2, A, =2. 


5. The matrix of the quadratic form is A = 


5 -2 

-2 5 


. The eigenvalues of A are A) =7 and A 2 =3. 


(a) By Theorem 6, the maximum value of x 7 Ax subject to the constraint x 7 x = 1 is the greatest 
eigenvalue X, of A, which is 7. 

(b) By Theorem 6, the maximum value of x T Ax subject to the constraint x 7 x = 1 occurs at a unit 

,'-1 

eigenvector u corresponding to the greatest eigenvalue A } of A. One may compute that 


1 


is an 


eigenvector corresponding to A., = 7, so u = ± 


-l/Vl 

1/V2 


(c) By Theorem 7, the maximum value of x T Ax subject to the constraints x r x = 1 and x 7 u = 0 is the 
second greatest eigenvalue A 2 of A, which is 3. 


6. The matrix of the quadratic form is A = 


7 3/2 

3/2 3 


The eigenvalues of A are =15/2 and A, =5/2. 


(a) By Theorem 6, the maximum value of x T Ax subject to the constraint x 7 x = 1 is the greatest 
eigenvalue A, of^, which is 15/2. 
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(b) By Theorem 6, the maximum value of \ Ax subject to the constraint x r x = 1 occurs at a unit 

."3 

eigenvector u corresponding to the greatest eigenvalue A,j of A. One may compute that 


is an 


eigenvector corresponding to A.j = 7, so u = ± 


3/Vi() 

i/VTo 


(c) By Theorem 7, the maximum value of x T Ax subject to the constraints x r x = 1 and x 7 u = 0 is the 
second greatest eigenvalue X 2 of A, which is 5/2. 

7. The eigenvalues of the matrix of the quadratic form are X, =2, X 2 = -1, and A, 3 = -4. By Theorem 6, 
the maximum value of x r Ax subject to the constraint x r x = 1 occurs at a unit eigenvector u 


corresponding to the greatest eigenvalue A,j of A. One may compute that 


1/2 

1 

1 


is an eigenvector 


corresponding to A.j = 2, so u = ± 


1/3 

2/3 

2/3 


8. The eigenvalues of the matrix of the quadratic form are A,j = 9, and X 2 = -3. By Theorem 6, the 

maximum value of x T Ax subject to the constraint x 7 x = 1 occurs at a unit eigenvector u corresponding 


to the greatest eigenvalue X, of A. One may compute that 


"-1" 


'-2' 

0 

and 

1 

1 


0 


are linearly independent 


eigenvectors corresponding to A, =2, so u can be any unit vector which is a linear combination of 


-1 

0 

1 


and 


-2 

1 

0 


. Alternatively, u can be any unit vector which is orthogonal to the eigenspace corresponding to 


the eigenvalue X 2 =-3. Since multiples of 


are eigenvectors corresponding to X 2 = -3, u can be any 


unit vector orthogonal to 


9. This is equivalent to finding the maximum value of x T Ax subject to the constraint x r x = 1. By Theorem 
6, this value is the greatest eigenvalue A,j of the matrix of the quadratic form. The matrix of the quadratic 

7 -f 


form is A = 


-1 3 

constrained maximum value is A,j = 5 + V5. 


and the eigenvalues of A are A.j = 5 + V5, X 2 = 5 - V5. Thus the desired 
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10. This is equivalent to finding the maximum value of x T Ax subject to the constraint x r x = 1 . By Theorem 
6, this value is the greatest eigenvalue Aj of the matrix of the quadratic form. The matrix of the quadratic 

'-3 -f 


form is A = 


-1 5 

constrained maximum value is A., = 1 + \Jl7. 


, and the eigenvalues of A are A; = 1 + \f\7 , A 2 = 1 - Vl7. Thus the desired 


11. Since x is an eigenvector of A corresponding to the eigenvalue 3, Ax = 3x, and x T Ax = x r (3x) = 
3(x r x) = 3 1| x 1 1 2 =3 since x is a unit vector. 


12. Letx be a unit eigenvector for the eigenvalue A. Then x T Ax = x 1 (Ax) = A(x r x) = A since x r x = 1 . So A 
must satisfy m < A < M. 

13. If m = M, then let t = (1 - 0)m + 0 M= m and x = u„. Theorem 6 shows that u T n A u „ = m. Now suppose 
that m < M, and let t be between m and M. Then 0 < t - m <M- m and 0 <(t - m)/(M - m) < 1 . Let 

a = (t- m)/(M-m), and let x = The vectors yjl-au n and Vcru, are orthogonal 

because they are eigenvectors for different eigenvectors (or one of them is 0). By the Pythagorean 
Theorem 

x r x =|| x|| 2 = || y/l-au lt || 2 +|| 4an x | 2 = | 1-or ||| u„ || 2 + 1«||| Uj \\ 2 = (\-a) + a = 1 
since u„ and u, are unit vectors and 0 < a < 1. Also, since u„ and u, are orthogonal, 
x T Ax = (-v/l-oru,, + \[au l ) T A{yj\-a\x n + -Jau l ) 

= (VT -au n + Vau 1 ) r (»7Vl ~ccu„ +M\fau l ) 

= \\-a\ wu^u„+| a\ Muf u, = (\-a)m + aM = t 
Thus the quadratic form x T Ax assumes every value between m and M for a suitable unit vector x. 


14. [Ml The matrix of the quadratic form is A = 


0 

1/2 

3/2 

15 

1/2 

0 

15 

3/2 

3/2 

15 

0 

1/2 

15 

3/2 

1/2 

0 


The eigenvalues of A are 


Aj =17, A, =13, A 3 =-14, andA 4 =-16. 

(a) By Theorem 6, the maximum value of x T Ax subject to the constraint x r x = 1 is the greatest 
eigenvalue Aj of^, which is 17. 

(b) By Theorem 6, the maximum value of x T Ax subject to the constraint x r x = 1 occurs at a unit 


eigenvector u corresponding to the greatest eigenvalue Aj of A. One may compute that 


1 

1 

1 

1 


is an 


eigenvector corresponding to Aj =17, so u = ± 


1/2 

1/2 

1/2 

1/2 


(c) By Theorem 7, the maximum value of x T Ax subject to the constraints x x = 1 and x 7 u = 0 is the 
second greatest eigenvalue A 2 of A, which is 13. 
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15. [M] The matrix of the quadratic form is A = 


0 

3/2 

5/2 

7/2 

3/2 

0 

7/2 

5/2 

5/2 

7/2 

0 

3/2 

7/2 

5/2 

3/2 

0 


. The eigenvalues of A are 


A,! =15/2, X 2 =- 1/2, A, =-5/2, and A 4 =-9/2. 

By Theorem 6, the maximum value 
eigenvalue A,j of^, which is 15/2. 


(a) By Theorem 6, the maximum value of \ T Ax subject to the constraint x r x = 1 is the greatest 


(b) By Theorem 6, the maximum value of x Ax subject to the constraint x x = 1 occurs at a unit 

T 


eigenvector u corresponding to the greatest eigenvalue X, of A. One may compute that 


is an 


eigenvector corresponding to X l =\5/2, so u = ± 


1 / 2 ' 

1/2 

1/2 

1/2 


(c) By Theorem 7, the maximum value of x T Ax subject to the constraints xx = 1 and x 7 u = 0 is the 
second greatest eigenvalue X 2 of A, which is -1/2. 


16. [M] The matrix of the quadratic form is A = 


X 2 =3, A, = 1, and A 4 = -9. 


4 

-3 

-5 

-5 

-3 

0 

-3 

-3 

-5 

-3 

0 

-1 

-5 

-3 

-1 

0 


. The eigenvalues of A are X, = 9, 


(a) By Theorem 6, the maximum value of x r Ax subject to the constraint x r x = 1 is the greatest 
eigenvalue X, of^, which is 9. 

(b) By Theorem 6, the maximum value of x T Ax subject to the constraint x r x = 1 occurs at a unit 

-2 


eigenvector u corresponding to the greatest eigenvalue Aj of A. One may compute that 


is an 


eigenvector corresponding to A t = 9, so u = ± 


'-2 /S' 
0 

1/V6 

1/S 


(c) By Theorem 7, the maximum value of x T Ax subject to the constraints x r x = 1 and x 7 u = 0 is the 
second greatest eigenvalue A 2 of A, which is 3. 
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17. [M] The matrix of the quadratic form is A = 


A 2 =-10, A, =-12, and A 4 =-16. 


-6 

-2 

-2 

-2 

-2 

-10 

0 

0 

-2 

0 

-13 

3 

-2 

0 

3 

-13 


. The eigenvalues of A are A, = -4, 


(a) By Theorem 6, the maximum value of x r Ax subject to the constraint x r x = 1 is the greatest 
eigenvalue A, of A, which is -4. 

(b) By Theorem 6, the maximum value of x r Ax subject to the constraint x 7 x = 1 occurs at a unit 

'-3~ 


eigenvector u corresponding to the greatest eigenvalue Aj of A. One may compute that 


is an 


eigenvector corresponding to A[ = -4, so u = ± 


-3/Vf2 
1 /yfn 
l/yjn 

1/yfU 


(c) By Theorem 7, the maximum value of x T Ax subject to the constraints x r x = 1 and x 7 u = 0 is the 
second greatest eigenvalue A 2 of A, which is -10. 


7.4 SOLUTIONS 


Notes: The section presents a modem topic of great importance in applications, particularly in computer 
calculations. An understanding of the singular value decomposition is essential for advanced work in science 
and engineering that requires matrix computations. Moreover, the singular value decomposition explains 
much about the structure of matrix transformations. The SVD does for an arbitrary matrix almost what an 
orthogonal decomposition does for a symmetric matrix. 


1. Let A = 


1 0 
0 -3 


. Then A 1 A = 


1 0 
0 9 


and the eigenvalues of A r A are seen to be (in decreasing 


order) A, = 9 and A 2 = 1 . Thus the singular values of A are a x = V9 = 3 and a 2 = Vl = 1 . 


2. Let A = 


-5 O' 
0 0 


Then A 1 A = 


25 0 
0 0 


, and the eigenvalues of A r A are seen to be (in decreasing 


order) Aj = 25 and A 2 = 0. Thus the singular values of A are <J l = V25 = 5 and cr 2 = Vo = 0. 


3. Let A = 


\[6 1 
0 V6 


. Then A 7 A = 


6 \[6 
V6 7 


, and the characteristic polynomial of A T A is 


A 2 -13A + 36 = (A-9)(A-4), and the eigenvalues of A T A are (in decreasing order) Aj =9 and A 2 =4. 
Thus the singular values of A are <J l = y/9 = 3 and <J 2 = V4 = 2. 
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V3 2 T 3 2^3 T 

4 . Let A = . Then A A= , and the characteristic polynomial of A A is 

0 V3J [ 2^3 7 . 

X 2 -10L + 9 = (A,-9)(A,-1), and the eigenvalues of A r A are (in decreasing order) A,j=9 and X 2 =\. 
Thus the singular values of A are (Tj = V 9=3 and a 2 = Vl = 1 . 


-3 0 T 9 0 T 

5. Let A= . Then A A= , and the eigenvalues of A A are seen to be ( in decreasing 

0 Oj L° °J 

order) A, 1 = 9 and X 2 = 0. Associated unit eigenvectors may be computed: 

rii roi 

X = 9: ,X = 0: 

oj L 1 . 

r 1 oi r r 

Thus one choice for V is V = ^ ^ . The singular values of A are <J l = A 9=3 and (J 2 = v0 = 0. Thus 

[3 01 

the matrix X is X = . Next compute 

0 oj 

1 „ M 

u i=— Av i= n 

tj\ l 0 

Because Ay 2 = 0, the only column found for U so far is Ui. Find the other column of U is found by 

2 r°~ 

extending {uj to an orthonormal basis for . An easy choice is u 2 = . 

'-1 01 

Let U = . Thus 

0 1 


A = VLV = 


-1 0Y 3 0Y 1 0 


0 1 0 0 0 1 


\-2 01 r 4 01 T 

6. Let A= 0 1 . Then A A= ^ ^ , and the eigenvalues of A A are seen to be (in decreasing 

order) X { =4 and X 2 = 1. Associated unit eigenvectors may be computed: 

rii roi 

X = 4: ,X = 1: 

_°J L 1 . 

[ 1 01 r r 

Thus one choice for V is V = . The singular values of A are cr, = V 4=2 and as = Vl =1. Thus 

0 lj 

[2 01 

the matrix X is X = . Next compute 

0 lj 

1 T-ll 1 f 0" 

Ui=— Av 1= u 2 =— A\ 2 = 

<j\ [ 0J a 2 [-1 

2 r- 1 °i 

Since {u l5 u 2 } is a basis for : , let U = . . Thus 


0 -1 


-1 0lf2 oY 1 0 


0 -10 10 1 
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7. Let A = 


2 -1 

2 2 


. Then A A = 


8 2 
2 5 


, and the characteristic polynomial of A T A is 


X 2 -13L + 36 = (X, - 9)(L - 4), and the eigenvalues of A r A are (in decreasing order) X t =9 and X 2 =4. 
Associated unit eigenvectors may be computed: 

L = 9: 


2/45 

T A . 

-1/45 

1/45 

, A — . 

2/45 


Thus one choice for V is V = 


2/V5 -1/V5 

1 /yf5 2/45 

3 0" 


as = 4 a = 2 . Thus the matrix I is X = 


0 2 


The singular values of A are (7 l = 49 = 3 and 


. Next compute 


u, = — Ay, = 


1/45 

2/45 


,u 2 = — Ay 2 


Since {u ls u 2 } is a basis for 2 , let U = 


a = uzv t = 


-2/45 
1/45 

1/45 -2/45 
2/45 1/45 


. Thus 


1/45 

-2/45 

“3 

0 " 

2/45 

1/45 

2/45 

i/4s_ 

0 

2 

-1/45 

2/45 


8. Let A = 


2 3' 

0 2 


Then A 1 A = 


4 6 

6 13 


, and the characteristic polynomial of Al A is 


X 2 -17L + 16 = (A,-16)(A,-1), and the eigenvalues of A 7 A are (in decreasing order) L, = 1 6 and X, 2 =l. 
Associated unit eigenvectors may be computed: 


X = \6: 


4/45' 

T — 1 . 

"-2/V5" 

2/45 

, A- — 1 . 

1/45 


Thus one choice for V is V = 
a 2 =4l=l. Thus the matrix X is X = 


1/45 -2/45 
2/45 1/45 

4 0 


0 1 


. The singular values of A are <J l = Vl6 = 4 and 
. Next compute 




L 

J 

1 , 

2/45 

1 , 

-1/45 

u, =—Av, = 

1/45 

,u 2 = — Ay 2 = 
^2 

2/45 


Since {u 1? u 2 } is a basis for S 2 , let U = 


A = UXV J = 


2/45 -l/4s' 
1/45 2/45 


. Thus 


~2/45 

-1/4S' 

'4 

0" 

1/45 

2/V5" 

1/45 

2 /4s 

0 

1 

-2/45 

1/45 _ 
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"7 

f 








"74 

32" 

9 . Let A ~ 

0 

0 

. Then A r A = 

32 

26 


5 

5 





and the characteristic polynomial of A T A is 


A 2 -100A + 900 = (A-90)(A-10), and the eigenvalues of A r A are (in decreasing order) Aj=90 and 
A 2 = 10. Associated unit eigenvectors may be computed: 


A, = 90: 


2/V5" 

l/y/5 


,A = 10: 


Thus one choice for V is V = 


<j 7 = a/To. Thus the matrix I is I = 


- 1 /V 5 
2 /VJ 

2 / yf 5 - 1 /V 5 
1/V5 2/V5 

3V10 0 

0 Vi 0 

0 0 


. The singular values of A are a x = V90 = 3 Vio and 


. Next compute 


"1/V2" 

u 2 =— ^v 2 = 

"-1/V2" 

0 

0 

1 /V 2 

^2 

1/V2 


u, =— Ay x = 


Since {u l5 u 2 } is not a basis for , we need a unit vector u 3 that is orthogonal to both U[ and u 2 . The 
vector u 3 must satisfy the set of equations ufx = 0 and u 2 x = 0. These are equivalent to the linear 
equations 


X| + 0x 2 + x 3 =0 
— jq + 0x 2 +x 3 = 0 


, so x = 


Therefore let U = 


"o' 


"0" 

1 

, and u 3 = 

1 

0 


0 

0" 



1 

. Thus 



1/V2 1/V2 0 



"1/V2 

-1/V2 

0" 

"3V10 

ol 

A = UZV t = 

0 

0 

1 

0 

V10 


1/V2 

1/V2 

0 

0 

0 - 


2 /V 5 1 /V 5 

- 1 /V 5 2 /V 5 



"4 

-2 








' 20 

-10" 

10 . Let A = 

2 

-1 

. Then A r A = 

_-!0 

5_ 


0 

0 





and the characteristic polynomial of A T A is 


A 2 - 25A = A(A - 25) , and the eigenvalues of A r A are (in decreasing order) Aj = 25 and A 2 = 0. 
Associated unit eigenvectors may be computed: 

A = 25: 


" 2 /V 5 " 


"1/V5" 

- 1 /V 5 

, A — u . 

2/V5 
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Thus one choice for V is V = 


2/V5 1/V5 

-1/V5 2/V5 

5 0" 


a 2 = %/o = 0. Thus the matrix X is X = 


0 0 
0 0 


. The singular values of A are cr l = V25 = 5 and 


. Next compute 


u, =—A\ l = 


2/yf5' 

1/yfS 

0 


Because Av 2 = 0, the only column found for U so far is u,. Find the other columns of U found by 
extending {ui} to an orthonormal basis for . 3 . In this case, we need two orthogonal unit vectors U 2 and 
u 3 that are orthogonal to Ui. Each vector must satisfy the equation ufx = 0, which is equivalent to the 
equation 2xi + x 2 = 0. An orthonormal basis for the solution set of this equation is 



1/V5 


" 0 " 

u 2 = 

-2/V5 

-»3 = 

0 


0 


1 


i 

2 /V 5 


Therefore, let U = 

1 /V 5 

- 



0 



. Thus 



2 /V 5 

1 /V 5 

0 

5 

0 " 



A = U1V t = 

1 /V 5 

- 2 /V 5 

0 

0 

0 

2 /V 5 

- 1 /V 5 


0 

0 

1 

0 

0 

_ 1 /V 5 

2/V5_ 



'-3 

r 








81 

-27“ 

11. Let A = 

6 

-2 

. Then A r A = 

-n 

9 


6 

-2 





and the characteristic polynomial of A T A is 


X 2 - 90£ = X(k - 90), and the eigenvalues of A r A are (in decreasing order) A,j = 90 and X 2 = 0. 
Associated unit eigenvectors may be computed: 


£ = 90: 


" 3/ VTo” 


1/V10" 

-1/VT0 

, A — u . 

3/V10 


Thus one choice for V is V = 


3 /V 10 1 / V 10 
- 1 /VT 0 3 /J 10 


. The singular values of A are cr, = ^90 = 3 VlO and 


<7i = Vo = 0. Thus the matrix X is £ = 


3V10 0 
0 0 
0 0 


. Next compute 


u , =— Ay 1 = 


-1/3 

2/3 

2/3 
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Because A\ 2 = 0 , the only column found for U so far is Ui. The other columns of U can be found by 
extending {ui} to an orthonormal basis for 3 . In this case, we need two orthogonal unit vectors 112 and 
u 3 that are orthogonal to Ui. Each vector must satisfy the equation ufx = 0, which is equivalent to the 
equation —x ] + 2x 2 + 2x 3 = 0. An orthonormal basis for the solution set of this equation is 



" 2/3" 


' 2/3" 

u 2 = 

-1/3 

,u 3 = 

2/3 


2/3 


_— ! / 3 


Therefore, let U = 


A = ITLV = 


-1/3 2/3 2/3' 

2/3 -1/3 2/3 

2/3 2/3 -1/3 


Thus 


'—1/3 

2/3 

2/3 

-1/3 

2/3" 

2/3 

3VTo 

0 

0 

0 

3/Vi() 

-l/VTo 

2/3 

2/3 

-1/3 

0 

0 

i/ VT o 

3/Vio 


12 . Let A = 


l 

l" 






2 

0" 

0 

i 

. Then A T A = 





0 

3 

-l 

i 





and the eigenvalues of A r A are seen to be (in decreasing order) 


A.j = 3 and X 2 = 2. Associated unit eigenvectors may be computed: 



"0" 


"1" 

A. = 3 : 

1 

CN 

II 

0 


Thus one choice for V is V = 


0 

1 


. The singular values of A are dj = V3 and cr 2 = %/2. Thus the 


V3 0 


matrix E is X = 

0 

V2 

. Next compute 



0 

0 






1 , 

U 2 = — ^v 2 = 

\ls[2 

u, =— A\! = 

1/V3 

0 



1/V3 


_-l /yf2 


Since {u l 5 u 2 } is not a basis for 3 , we need a unit vector u 3 that is orthogonal to both u 3 and u 2 . The 
vector u 3 must satisfy the set of equations ufx = 0 and u 2 x = 0. These are equivalent to the linear 
equations 


Xj + x 2 + x 3 
x, + 0x 2 - x 3 


r 


1/ V6~ 

-2 

,andu 3 = 

-2/V6 

1 


1/V6 
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"l/>/3 

1/V2 

1/V6 _ 


Therefore let U = 

1/V3 

0 

-21 S 

. Thus 


1/^ 

-I/a/2 

1/V6 




'l/y/3 

1/V2 

1/V6~ 

\/3 

ol 

A = UZV t = 

1/V3 

0 

-2/V6 

0 

>12 


1/V3 

- 1 /V 2 

1/V6 

0 

0 


13 . Let A = 






"3 

2" 




"3 

2 

2" 

. Then A r = 

2 

3 

11 

II 

E-i 

"17 

8" 

2 

3 

-2 





_ 8 

17 _ 





2 

-2 





TT a T 


, and the eigenvalues of A A 


are seen to be (in decreasing order) L, = 25 and 1 2 = 9- Associated unit eigenvectors may be computed: 


1 = 25: 


1/V2" 

1/V2 


1 = 9: 


Thus one choice for V is V = 


-1/V2 
1/V2 

1/V2 -1/V2 
1/V2 1/V2 

5 0" 


<j 1 = V9 = 3. Thus the matrix X is X = 


0 3 
0 0 


. The singular values of A r are tJ l = \[l5 = 5 and 


Next compute 



"l/V2" 


"-1/V18" 

1 ,T 

u, = — A Vj = 

1/V2 

1 ,T 

u 2 = — A v 2 = 

1/Vl8 

a \ 

0 

(J 2 

-4/Vl8 


Since {u l5 u 2 } is not a basis for 3 , we need a unit vector u 3 that is orthogonal to both u 3 and u 2 . The 
vector u 3 must satisfy the set of equations ufx = 0 and u 2 x = 0. These are equivalent to the linear 
equations 


A | T X 2 f UA 3 

-JC[ + x 2 - 4x 3 = 0 ’ 



"-2" 


"-2/3" 

= 0 




-so x = 

2 

, and u 3 = 

2/3 

= 0 

1 


1/3 



’l/V2 

-1/Vl8 

-2/3" 


Therefore let U = 

1/V2 

1/Vl8 

2/3 

. Thus 


0 

-4/Vl8 

1/3 



A r =U'LV t = 

I/V 2 - 1/^8 -2/3 
1/V2 1/Vl8 2/3 

“5 0" 

0 3 

1/V2 1/V2 


0 -4/Vl8 1/3 

0 0 

-1/V2 1/V2 
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An SVD for A is computed by taking transposes: 






1/42 

1/42 

0 

A = 

1/42 

- 1/42 

“5 0 0" 

- i / 4 is 

i / 4 ii 

-4/-v/l8 


1/42 

\/ 42 _ 

0 3 0 

-2/3 

2/3 

1/3 


14. From Exercise 7, A = U£V T with V = 


2/45 

1/45 


-l/vr 

2/45 _ ' 


Since the first column of V is unit eigenvector 


associated with the greatest eigenvalue A,[ of A r A, so the first column of V is a unit vector at which 
|| Ax || is maximized. 


15. a. Since A has 2 nonzero singular values, rank A = 2. 


b. By Example 6, {u l 5 u 2 } = 



" .40' 


"-.78" 



.37 

? 

-.33 



-.84 


-.52 



is a basis for Col A and {v 3 } = 



.58" 



-.58 



.58 



is a basis 


for Nul A. 

16. a. Since A has 2 nonzero singular values, rank A = 2. 


b. By Example 6, {u l 5 u 2 } = 


a basis for Nul A. 



"-.86" 


"-.If 



.31 

9 

.68 



.41 


-.73 



is a basis for Col A and {v 3 ,v 4 } = 



" .65 ' 


"-.34" 



.08 


.42 



-.16 

? 

-.84 



-.73 


-.08 



1 is 


17. Let A = t/XF r = VLV *. Since A is square and invertible, ra nk A = n, and all of the entries on the 
diagonal of X must be nonzero. So A~ l = ((/XL -1 ) -1 = E2T 1 U~ l = FIT 1 U T . 


18. First note that the determinant of an orthogonal matrix is ±1, because 1 = det/ = dct U T U = 
(det(7 r )(det(7) = (dett/) 2 . Suppose that A is square and A = ITZV 7 . Then X is square, and 
det A = (det C/)(det X)( det V T ) = ±det X = ±cr l ...<7 n . 

19. Since U and V are orthogonal matrices, 

A T A = (f/XF 7 ’) r f/XF r = VI. T U T UI.V T = F(X r X)F r = F(X r X)F _1 

If <7 l ,...,<J r are the diagonal entries in X, then X X is a diagonal matrix with diagonal entries cr, ,...,cr. 

and possibly some zeros. Thus V diagonalizes A T A and the columns of V are eigenvectors of A T A by 
the Diagonalization Theorem in Section 5.3. Likewise 

AA t = U HV t (U 2,V t ) t =U2,V t V2, t U t = f/(XX r )f/ r =f/(XX r )f/ _1 

so U diagonalizes A A 7 ' and the columns of U must be eigenvectors of A A 1 . Moreover, the 
Diagonalization Theorem states that (7 l ,...,<7 r are the nonzero eigenvalues of A A . I lencc <7 x ,...,o r 
are the nonzero singular values of A. 

20. If A is positive definite, then A = PDP T , where P is an orthogonal matrix and D is a diagonal matrix. 
The diagonal entries of D are positive because they are the eigenvalues of a positive definite matrix. 
Since P is an orthogonal matrix, PP 1 = I and the square matrix P 1 is invertible. Moreover, 
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( P 1 ) 1 = (P 1 ) 1 = P = (P 1 ) T , so P T is an orthogonal matrix. Thus the factorization A = PDP T has the 
properties that make it a singular value decomposition. 

21. Let A = UY.V 7 . The matrix PU is orthogonal, because P and U are both orthogonal. (See Exercise 29 in 
Section 6.2). So the equation PA = (P(7)XE r has the form required for a singular value decomposition. 
By Exercise 19, the diagonal entries in X are the singular values of PA. 

22. The right singular vector v, is an eigenvector for the largest eigenvector A,j of A r A. By Theorem 7 in 
Section 7.3, the second largest eigenvalue X 2 is the maximum of x r (A r A)x over all unit vectors 
orthogonal to Vj . Since x r (A r A)x = || Ax || 2 , the square root of X 2 , which is the second largest singular 
value of A, is the maximum of || Ax || over all unit vectors orthogonal to Vj. 

23. From the proof of Theorem 10, (7X = [cTjUj ... cr,.u,. 0 ... 0], The column-row expansion of the 

product (t/X)E r shows that 

T " 

Vl 

T T 

: =(T 1 U 1 V 1 + . . . + <7 r u r x r 

T 

v « J 

where r is the rank of A. 


A = (IPL)V T = (L'X) 


24. From Exercise 23, A =cT|V 1 Ui + . . . + cr,.v,.u,. . Then since = 


A t Uj = (tTjVjuf + . . . + a,.y r u T r )xij = (a v,u ; )u, = rr ; .v y (u'u ; .) = crv, 


25. Consider the SVD for the standard matrix A of T, say A = UEV r . Let B = {v 1( ..., v n } and 

C = {u ! , , u ,„ } be bases for n and m constructed respectively from the columns of V and U. Since the 

columns of V are orthogonal, V 7 v ; = e . , where e ; is the /th column of the n x n identity matrix. To find 
the matrix of T relative to B and C, compute 

T (x j ) = A\j= LTE V T v / = L'Xe , = C<xe ; = cr.Ce y = cr.u y 

so [T(v )] c = cr / e / . Formula (4) in the discussion at the beginning of Section 5.4 shows that the 
“diagonal” matrix X is the matrix of T relative to B and C. 


-18 13 -4 4] [ 528 -392 224 -176' 

2 19 -4 12 T -392 1092 -176 536 

26. [Ml Let A = . Then A A= , and the eigenvalues 

-14 11 -12 8 224 -176 192 -128 

-2 21 4 8j [-176 536 -128 288 

of A T A are found to be (in decreasing order) A.j =1600, X 2 = 400, X 3 =100, and X 4 = 0. Associated 
unit eigenvectors may be computed: 
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Thus one choice for V is V = 


-A .8 A -.2 

.8 .4 -.2 -A 

-.2 A -.8 .4 

.4 .2 .4 .8 

"40 0 0 0 


. The singular values of A are a x = 40, a x = 20, 


(T 3 = 10, and o 4 = 0. Thus the matrix X is X = 


0 20 0 0 
0 0 10 0 
0 0 0 0 


. Next compute 



“.5“ 


“-.5" 

1 

.5 

1 

.5 

— Ay x = 


, u, = — Ay 2 = 



.5 

C 7 2 

-.5 


.5 


.5 



Because Av 4 = 0 , only three columns of (/have been found so far. The last column of U can be found 
by extending {ui, 112, 113} to an orthonormal basis for 4 . The vector U4 must satisfy the set of equations 
ufx = 0, u 2 x = 0, and u 3 x = 0. These are equivalent to the linear equations 


X\+ x 2 + x 3 + x 4 = 0 
— JCj + x 2 -x 3 + x 4 = 0, SO X = 
—x l + x 2 + x 3 - x 4 = 0 


Therefore, let U = 


.5 

.5 

.5 

.5 


A = ITLV = 


-.5 

.5 


"- 1 " 


'-.5' 

-1 

1 

, and u 4 = 

-.5 

.5 

1 


.5 


-.5 -.5 

.5 .5 


.5 

-.5 


-.5 

-.5 

.5 

.5 


. Thus 


5 

-.5 

-.5 

-.5" 

"40 

0 

0 

0 " 

'-.4 

.8 

-.2 

A 

5 

.5 

.5 

-.5 

0 

20 

0 

0 

.8 

.4 

.4 

.2 

5 

-.5 

.5 

.5 

0 

0 

10 

0 

.4 

-.2 

-.8 

.4 

5 

.5 

-.5 

.5 

0 

0 

0 

0 

-.2 

-.4 

.4 

.8 


27. [M] Let A = 







41 

-32 

-38 

14 

- 8 " 

“ 6 -8 

-4 

5 

-4" 


-32 

118 

-3 

-92 

74 

2 7 

-5 

-6 

4 











. Then A T A = 

-38 

-3 

121 

10 

-52 

0 -1 

-8 

2 

2 


14 

-92 

10 

81 

-72 

-1 -2 

4 

4 

- 8 _ 












. ~ 8 

74 

-52 

-72 

100 


eigenvalues of A 7 A are found to be (in decreasing order) A.j = 270.87, X 2 = 147.85, X 3 = 23.73, 
X 4 =18.55, and X 5 = 0. Associated unit eigenvectors may be computed: 



7.4 


Solutions 


415 


“-. 10 “ 


"-.39" 


"-.74" 


.41“ 


"-.36" 

.61 


.29 


-.27 


-.50 


-.48 

-.21 

,A, 2 : 

.84 

a 3 • 

J 

o 

, 7,4 : 

.45 

,X 5 : 

-.19 

-.52 


-.14 


.38 


-.23 


-.72 

.55_ 


-.19 


,49_ 


.58_ 


-.29 


Thus one choice for V is V = 


“-.10 

-.39 

-.74 

.41 

-.36“ 


.61 

.29 

-.27 

-.50 

-.48 


-.21 

.84 

-.07 

.45 

-.19 

. The : 

-.52 

-.14 

.38 

-.23 

-.72 


.55 

-.19 

.49 

.58 

-.29 


4.87, 

and a 4 

= 4.31. 

Thus the matrix X is 


. The nonzero singular values of A are 


X = 


16.46 

0 

0 

0 


0 

12.16 

0 

0 


0 

0 


Next compute 


u, =— Ay i = 


4.87 

0 0 



0 

4.31 0 



“-.57“ 



“-.65“ 

.63 

1 


-.24 


,u, = — 4vo = 


.07 

CJ 2 


-.63 

_-.51_ 



.34 

“-.42" 



“ .27“ 

-.68 

1 


-.29 


c 

II 

II 


.53 

C7 4 


-.56 

-29 



-.73 


Since {u 1 ,u 2 ,u 3 ,u 4 } is a basis for 4 , let U = 


-.57 

-.65 

-.42 

.27 

.63 

-.24 

-.68 

-.29 

.07 

-.63 

.53 

-.56 

-.51 

.34 

-.29 

-.73 


. Thus 


A = ITLV t 











“-.10 

.61 

-.21 

-.52 

.55“ 

“-.57 

-.65 

-.42 

.27“ 

“16.46 

0 

0 

0 

0 “ 

-.39 

.29 

.84 

-.14 

-.19 

.63 

-.24 

-.68 

-.29 

0 

12.16 

0 

0 

0 

-.74 

-.27 

-.07 

.38 

.49 

.07 

-.63 

.53 

-.56 

0 

0 

4.87 

0 

0 

.41 

-.50 

.45 

-.23 

.58 

-.51 

.34 

-.29 

-.73 

0 

0 

0 

4.31 

0 















-.36 

-.48 

-.19 

-.72 

-.29 
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28. [M] Let A = 


“ 4 

0 

-7 

-7' 


“102 

-43 

-27 

52“ 

-6 

1 

11 

9 

. Then A T A = 

-43 

30 

-33 

-88 

7 

-5 

10 

19 


-27 

-33 

279 

335 

-1 

2 

3 

-1 


52 

-88 

335 

492 


and the eigenvalues of 


A t A are found to be (in decreasing order) A,j = 749.9785, A 2 = 146.2009, A, 3 = 6.8206, and 


A 4 =1.3371x 10 6 . The singular values of A are thus a x =27.3857, (72 =12.0914, cr 3 =2.61163, and 


a 4 = .00115635. The condition number o x lo 4 =23,683. 


29. [M] Let A = 


“5 

3 

1 

7 

9“ 


“255 

168 

90 

160 

47“ 

6 

4 

2 

8 

-8 


168 

111 

60 

104 

30 

7 

5 

3 

10 

9 

. Then A T A = 

90 

60 

34 

39 

8 

9 

6 

4 

-9 

-5 


160 

104 

39 

415 

178 

8 

5 

2 

11 

4 


. 47 

30 

8 

178 

267_ 


, and the eigenvalues 


of A r A are found to be (in decreasing order) Aj = 672.589, A, 2 =280.745, A, 3 =127.503, A 4 =1.163, 
and A 5 = 1.428xl0~ 7 . The singular values of A are thus o x =25.9343, a\ =16.7554, ct 3 =11.2917, 
o 4 =1.07853, and cr 5 = .000377928. The condition number <7, / cr 5 =68,622. 


7.5 SOLUTIONS 

Notes: The application presented here has turned out to be of interest to a wide variety of students, including 
engineers. 1 cover this in Course Syllabus 3 described above, but 1 only have time to mention the idea briefly 
to my other classes. 


1. The matrix of observations is X = 


19 22 6 3 2 20 

12 6 9 15 13 5 


and the sample mean is 


1 

“72“ 


“12“ 

6 

60 


10 


B = 


. The mean-deviation form B is obtained by subtracting M from each column of X, so 
The sample covariance matrix is 


7 10 -6 -9 -10 8 

2-4-15 3-5 


5 = 


li 

" 430 

-135“ 


86 

-27“ 

6-1 5 

-135 

80 


-27 

16 



“1 5 2 6 7 3“ 

1 

“24“ 


“4“ 

2. The matrix of observations is X = 


and the sample mean is M = — 


= 



3 11 6 8 15 11 

6 

54 


9 


The mean- deviation form B is obtained by subtracting M from each column of X, so 
B - 1 |. The sample covariance matrix is 

5.6 8 

8 18 


-3 

1 -2 

2 

3 

-1 

-6 

2 -3 

-1 

6 

2 

5 = 

1 T 
BB t 

_ 1 

“28 

40 


6-1 

_ 5 

40 

90 
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3. The principal components of the data are the unit eigenvectors of the sample covariance matrix S. One 

r 86 -27' 

computes that (in descending order) the eigenvalues of S = 


^-27 16 

A 2 =6.79593. One further computes that corresponding eigenvectors are v, = 


are A, L =95.2041 and 
and 


-2.93348 

1 


u, = 


.340892 

1 

.946515 

-.322659 


These vectors may be normalized to find the principal components, which are 


for A,j =95.2041 and u 2 = 


.322659 

.946515 


for A 2 =6.79593. 


4. The principal components of the data are the unit eigenvectors of the sample covariance matrix S. One 

[5.6 

computes that (in descending order) the eigenvalues of S = 


18 


A 2 =1.67874. One further computes that corresponding eigenvectors are v, = 


are Aj = 21.9213 and 
and 


.490158 

1 


v, = 


-2.04016 

1 


. These vectors may be normalized to find the principal components, which are 


Ui = 

' .44013' 
.897934_ 

for Aj =21.9213 and u 2 = 

'-.897934' 

.44013 

for A., 




'164.12 

32.73 

81.04' 

5. [M] The largest eigenvalue of S = 

32.73 

539.44 

249.13 




81.04 

249.13 

189.11 


is A.j = 677.497, and the first principal 


component of the data is the unit eigenvector corresponding to A.) , which is u, = 


.129554 

.874423 

.467547 


. The fraction 


of the total variance that is contained in this component is A[ /tr(S) = 677.497/(164.12 + 539.44 + 

189.1 1) = .758956, so 75.8956% of the variance of the data is contained in the first principal component. 


6. [M] The largest eigenvalue of S = 


29.64 

18.38 

5.00 

18.38 

20.82 

14.06 

5.00 

14.06 

29.21 


is A.) =51.6957, and the first principal 


component of the data is the unit eigenvector corresponding to A,, which is Uj = 


.615525 

.599424 

.511683 


. Thus one 


choice for the new variable is y ] = .6 1 5 5 2 5 x, + .599424x 2 + .5 1 1 683 v 3 . The fraction of the total variance 
that is contained in this component is / tr(^) = 51.6957/(29.64 + 20.82 + 29.21) = .648872, so 
64.8872% of the variance of the data is explained by y x . 
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7. Since the unit eigenvector corresponding to X,j =95.2041 is Uj = 


.946515" 
— .322659 J ’ 


one choice for the new 


variable is y x = .9465 1 5x x -,322659x 2 . The fraction of the total variance that is contained in this 
component is A,j / tr(S) = 95.2041/(86 + 16) = .933374, so 93.3374% of the variance of the data is 
explained by y, . 


8. Since the unit eigenvector corresponding to A.[ =21.9213 is Uj = 


.44013 

.897934 


one choice for the new 


variable is y x = .4401 3„v, + ,897934x 2 . The fraction of the total variance that is contained in this 
component is X x /tr(S) = 21.9213/(5.6 + 18) = .928869, so 92.8869% of the variance of the data is 
explained by y t . 

“5 2 0" 

9. The largest eigenvalue of S = 2 6 2 is X, = 9, and the first principal component of the data is the 

0 2 7 


unit eigenvector corresponding to , which is U[ = 2/3 . Thus one choice for y is 


y = (1/3)* + (2/3)jc 2 + (2/3)jc 3 , and the variance ofy is X, = 9. 


5 4 2 


10. [M] The largest eigenvalue of S = 4 11 4 1 is a, = 1 5, and the first principal component of the data 

2 4 5 


is the unit eigenvector corresponding to X, ls which is Uj = 2/-J6 . Thus one choice for y is 

1/V6 

y = (1 / yj6)x l + (2 / V6)x 2 + (1 / \[6)x 3 , and the variance of y is A.j = 1 5. 


11. a. If w is the vector in / ,,jV with a 1 in each position, then [X, ... X w ]w = Xj +... + X W = 0 since the 

X A , are in mean-deviation form. Then 

[Y, ... Y w ]w = [ J P r X 1 ... J P r X w ]w = J P r [X, ... X 7V ]w = ,P r 0 = 0 

Thus Y, + . . . + Y /V = 0, and the Y k are in mean-deviation form, 
b. By part a., the covariance matrix S Y of Y X ,...,Y N is 

5v=^ r j[Y 1 ... Y n ][Y x ... Y N f 

= ^r/ r [ x ‘ -• x ^ r [ x i - x ,]) r 

-• X ^H x i ••• X N f)p = P r SP 

-i 

since the X k are in mean-deviation form. 
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12. By Exercise 1 1 , the change of variables X = PY changes the covariance matrix S of X into the covariance 
matrix P T SP of Y. The total variance of the data as described by Y is tr (P T SP). However, since P T SP 
is similar to S, they have the same trace (by Exercise 25 in Section 5.4). Thus the total variance of the 
data is unchanged by the change of variables X = PY. 


13. Let M be the sample mean for the data, and let X k = X k - M. Let B = . . . X N J be the matrix of 

observations in mean-deviation form. By the row-column expansion of BB 1 , the sample covariance 
matrix is 


1 T 
S = BB t 

N - 1 



= T7^Z^X[=-^-f(X (t -M)(X i -M) r 
a - 1 k=l tv - 1 k=l 


Chapter 7 SUPPLEMENTARY EXERCISES 


1. a. True. This is just part of Theorem 2 in Section 7. 1 . The proof appears just before the statement of 
the theorem. 

b. False. A counterexample is A = 

c. True. This is proved in the first part of the proof of Theorem 6 in Section 7.3. It is also a 
consequence of Theorem 7 in Section 6.2. 

d. False. The principal axes of x T Ax are the columns of any orthogonal matrix P that diagonalizes A. 
Note : When A has an eigenvalue whose eigenspace has dimension greater than 1 , the principal axes 
are not uniquely determined. 

n -ii 

e. False. A counterexample is P = . The columns here are orthogonal but not orthonormal. 



f. False. See Example 6 in Section 7.2. 


g. False. A counterexample is A = 


2 0 
0 -3 


and x = . Then x T Ax = 2 > 0 , but x T Ax is an 

0 


indefinite quadratic form. 

h. True. This is basically the Principal Axes Theorem from Section 7.2. Any quadratic form can be 
written as x T Ax for some symmetric matrix A. 

i. False. See Example 3 in Section 7.3. 

j. False. The maximum value must be computed over the set of unit vectors. Without a restriction on 
the norm of x, the values of x T Ax can be made as large as desired. 
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k. False. Any orthogonal change of variable x = Py changes a positive definite quadratic form into 
another positive definite quadratic form. Proof: By Theorem 5 of Section 7.2., the classification of a 
quadratic form is determined by the eigenvalues of the matrix of the form. Given a form x r Ax, the 
matrix of the new quadratic form is P~ l AP, which is similar to A and thus has the same eigenvalues 
as A. 

l. False. The term “definite eigenvalue” is undefined and therefore meaningless, 

m. True. If x = Py, then x T Ax = (Py) T A(Py) = y 1 P T APy = y T P~ l APy . 


n. 


o. 

P 


q 


False. A counterexample is U = 


1 

1 


-1 

-1 


. The columns of U must be orthonormal to make UU T x 


the orthogonal projection of x onto Col U. 

True. This follows from the discussion in Example 2 of Section 7.4., which refers to a proof given 
in Example 1 . 


True. Theorem 10 in Section 7.4 writes the decomposition in the form VLV T , where U and V are 
orthogonal matrices. In this case, V T is also an orthogonal matrix. Proof: Since V is orthogonal, V 
is invertible and V~ l = V T . Then ( V T )~ 1 = (E _1 ) r = (V T ) T , and since Eis square and invertible, V T 
is an orthogonal matrix. 


False. A counterexample is A = 


2 

0 


. The singular values of A are 2 and 1 , but the singular 


values of A T A are 4 and 1. 


2. a. Each term in the expansion of A is symmetric by Exercise 35 in Section 7. 1 . The fact that 

(B + C) T = B 1 + C T implies that any sum of symmetric matrices is symmetric, so A is symmetric. 

b. Since ufu, =1 and u'Ju, =0 for/ ^ 1, 

Au { = (XjUjuf M + . . . + (A.„u„u^ )uj =X 1 u 1 (ufu 1 ) + ... + X B u„ (u^ ) = A,^ 

Since Uj ^ 0 , A, is an eigenvalue of A. A similar argument shows that a . is an eigenvalue of A for 
7 = 2, ..., 77 . 

3. If ra nk A = r, then dimNul A = n — r by the Ra nk Theorem. So 0 is an eigenvalue of A with multiplicity 
?7 - r, and of the n terms in the spectral decomposition of A exactly n - r are zero. The remaining r terms 
(which correspond to nonzero eigenvalues) are all rank 1 matrices, as mentioned in the discussion of the 
spectral decomposition. 

4. a. By Theorem 3 in Section 6.1, (Col A) 1 = Nul A r = Nul A since A r = A. 

b. Let y be in ". By the Orthogonal Decomposition Theorem in Section 6.3, y = y + z, where y is in 
Col A and z is in (Col A) 1 . By part a., z is in Nul A. 


5. If Ax = X\ for some nonzero X, then v = A l Ax = A(k *v), which shows that v is a linear combination of 
the columns of A. 

6. Because A is symmetric, there is an orthonormal eigenvector basis {u l5 ...,u n } for ”. Let /•= rank T. 

If r = 0, then A = O and the decomposition of Exercise 4(b) is y = 0 + y for each y in if r = n then the 
decomposition is y = y + 0 for each y in R". 

Assume that 0 < r < n. Then dimNul A = n - r by the Ra nk Theorem, and so 0 is an eigenvalue of A with 
multiplicity n - r. Hence there are r nonzero eigenvalues, counted according to their multiplicities. 
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Renumber the eigenvector basis if necessary so that U|,...,u,. are the eigenvectors corresponding to the 
nonzero eigenvalues. By Exercise 5, u l 5 ...,u ; . are in Col A. Also, u r+ 1 ,...,u n are in Nul A because these 
vectors are eigenvectors corresponding to the eigenvalue 0. For y in 1 ", there are scalars c 1 ,...,c„ such 
that 

y = qu, + . . . + c,.u r + c r+1 u r+1 + . . . + q,u„ 

v V J v V J 

y z 

This provides the decomposition in Exercise 4(b). 

7. If A = R t R and R is invertible, then A is positive definite by Exercise 25 in Section 7.2. 

Conversely, suppose that A is positive definite. Then by Exercise 26 in Section 7.2, A = B r B for some 
positive definite matrix B. Since the eigenvalues of B are positive, 0 is not an eigenvalue of B and B is 
invertible. Thus the columns of B are linearly independent. By Theorem 12 in Section 6.4, B = QR for 
some n x n matrix Q with orthonormal columns and some upper triangular matrix R with positive entries 
on its diagonal. Since Q is a square matrix, Q r Q = I, and 

A = B t B = (. QR) t (QR) = R t Q t QR = R r R 
and R has the required properties. 

8. Suppose that A is positive definite, and consider a Cholesky factorization of A = R 7 R with R upper 
triangular and having positive entries on its diagonal. Let D be the diagonal matrix whose diagonal 
entries are the entries on the diagonal of R. Since right-multiplication by a diagonal matrix scales the 
columns of the matrix on its left, the matrix L = R r D 1 is lower triangular with 1 ’s on its diagonal. 

If U = DR, then A = R T D~ l DR = LU. 

9. If A is an m x n matrix and x is in ", then x r A r Ax = (Ax) r (Ax) = || Ax || 2 > 0. Thus A r A is positive 
semidefinite. By Exercise 22 in Section 6.5, ra nk A T A = rank A. 

10. If ra nk G = r, then dimNul G = n — r by the Ra nk Theorem. Hence 0 is an eigenvalue of G with 
multiplicity n - r, and the spectral decomposition of G is 

G = A-jUjuf + . . . + A,,.u,.u^ 

Also A,j,...,A, f . are positive because G is positive semidefinite. Thus 

G = (7^Ui)(^Ui r ) + ... + (7V»,)(VV»/) 

By the column-row expansion of a matrix product, G = BB l where B is the n x r matrix 
B = iq ... VVi,.]. Finally, G = A T A for A = B T . 

11. Let A = U'LV r be a singular value decomposition of A. Since U is orthogonal, U T U = / and 

A = LTZU t UV t = PQ where P = U'LU 1 = VZU~ l and Q = UV T . Since X is symmetric, P is 

symmetric, and P has nonnegative eigenvalues because it is similar to X, which is diagonal with 
nonnegative diagonal entries. Thus P is positive semidefinite. The matrix Q is orthogonal since it is the 
product of orthogonal matrices. 

12. a. Because the columns of V r are orthonormal, 

AA + y = (U r DVj)(V r D-Q T r )y = ( U r DD~ x U J r )y = U r U T r y 
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Since U r Ujy is the orthogonal projection of y onto Col U r by Theorem 10 in Section 6.3, and 
since Col U r = Col A by (5) in Example 6 of Section 7.4, AA + y is the orthogonal projection of 
y onto Col A. 

b. Because the columns of U r are orthonormal, 

A + Ax = {V r D~ l U T r )(U,DVj)x = (V r D~ l DV r T )x = V r Vjx 
Since V r Vjx is the orthogonal projection of x onto Col V r by Theorem 10 in Section 6.3, and since 
Col V r = Row A by (8) in Example 6 of Section 7.4, A + Ax is the orthogonal projection of x onto 
Row A. 

c. Using the reduced singular value decomposition, the definition of A + , and the associativity of matrix 
multiplication gives: 

AA + A = (U r D Vj )(V r D~'U T r )(U r D Vj ) = (U r DD~ l U T r )(U,.DV r T ) 

= U r DD~ l DV r T = U,,DVj = A 

A + AA + = (V r LT ] Ul )(U,.DVj )(V r D~ l U , r ) = {V r D~ x DVj W r D~ x U T r ) 

= V r D-'DD-'uJ = V r D~ x U T r = A + 

13. a. If b = Ax, then x + = A + b = A + Ax. By Exercise 12(a), x + is the orthogonal projection of x onto 

Row A. 

b. From part (a) and Exercise 12(c), Ax + = A(A + Ax) = (AA + A)x = Ax = b. 

c. Let 4u = b. Since x + is the orthogonal projection of x onto Row A, the Pythagorean Theorem shows 
that || u || 2 = || x + || 2 + || u-x + || 2 > || x + || 2 , with equality only if u = x + . 

14. The least-squares solutions of Ax = b are precisely the solutions of Ax = b, where b is the orthogonal 
projection of b onto Col A. From Exercise 13, the minimum length solution of^4x = b is A + b, so Ad 
is the minimum length least-squares solution of Ax = b. However, b = AA + b by Exercise 12(a) and 
hence A + b = A + AA + b = A + b by Exercise 12(c). Thus A + b is the minimum length least-squares solution 
ofHx = b. 

15. [M] The reduced SVD of A is A = U r DV, T , where 

“.966641 .253758 -.034804 

.185205 -.786338 -.589382 

U r = 

.125107 -.398296 .570709 

.125107 -.398296 .570709 

“-.313388 .009549 .633795 

-.313388 .009549 .633795 

and V r = -.633380 .023005 -.313529 

.633380 -.023005 .313529 

.035148 .999379 .002322 

So the pseudoinverse A + = V r D~ l U ]. may be calculated, as well as the solution x = A + b for the system 
Ax = b: 



“9.84443 

0 

0“ 

,D = 

0 

2.62466 

0 


0 

0 

1.09467 
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"-.05 

-.35 

.325 

.325“ 


" .7“ 

-.05 

-.35 

.325 

.325 


.7 

-.05 

.15 

-.175 

-.175 

,x = 

-.8 

.05 

-.15 

.175 

.175 


.8 

.10 

-.30 

-.150 

-.150 


.6 


Row reducing the augmented matrix for the system A T z = x shows that this system has a solution, so x 



u = ca[ + da 2 . One computes that || x || = Vl31/50, while || x + u ||= ^/(131/50) + 2 c 2 + 2 d 2 . Thus if 
u ^ 0, || x || < || x + u ||, which confirms that x is the minimum length solution to Ax = b. 


16. [M] The reduced SVD of A is A = U,.DVj , where 


"-.337977 

.936307 

.095396“ 









“12.9536 

0 

0“ 

.591763 

.290230 

-.752053 

,D = 

0 

1.44553 

0 

-.231428 

-.062526 

-.206232 

0 

0 

.337763 


-.694283 

-.187578 

-.618696 


— 




-.690099 

.721920 

.050939 

0 

0 

0 

.341800 

.387156 

-.856320 

.637916 

.573534 

.513928 

0 

0 

0 


So the pseudoinverse A + = V r D v U T r may be calculated, as well as the solution x = A + b for the 
system Ax = b: 


“.5 

0 

-.05 

-.15“ 


“2.3“ 

0 

0 

0 

0 


0 

0 

2 

.5 

1.5 

,x = 

5.0 

.5 

-1 

-.35 

-1.05 


-.9 

0 

0 

0 

0 


0 


Row reducing the augmented matrix for the system A r z = x shows that this system has a solution, so x 



u = ca, + da 2 . One computes that || x || = -s/31 1/10, while || x + u || = -^(311/10 ) + c 2 +d 2 . Thus if u ^ 0, 
|| x || < || x + u ||, which confirms that x is the minimum length solution to Ax = b. 



